A backtesteremben nagyon sok adatot kell kezelni mem\u00f3ri\u00e1ban, sok gigab\u00e1jtot. A mem\u00f3riacache-emben t\u00f6m\u00f6r\u00edtve vannak az adatok. T\u00f6m\u00f6r\u00edt\u00e9sre eddig a .NET GZip algoritmus\u00e1t haszn\u00e1ltam, fastest m\u00f3dban, \u00edgy elfogadhat\u00f3 sebess\u00e9get \u00e9s t\u00f6m\u00f6r\u00edt\u00e9st kapva.
\nMost viszont olvastam r\u00f3la, hogy vannak alternat\u00edv algoritmusok is. Tettem h\u00e1t egy pr\u00f3b\u00e1t, az al\u00e1bbi eredm\u00e9nyeket kapva:<\/p>\n
.NET GZipStream fastest mode:
\nCompression time: 00:00:00.1801551, compressed size: 75,122.00
\nDecompression time: 00:00:00.2001859<\/p>\n
Ez a baseline.<\/p>\n
Snappy native:
\nhttps:\/\/snappy4net.codeplex.com\/
\nCompression time: 00:00:00.1815305, compressed size: 508,387.00
\nDecompression time: 00:00:00.1464451<\/p>\n
H\u00e1t, ez nem gy\u0151z\u00f6tt meg.<\/p>\n
Lz4:
\nhttp:\/\/lz4net.codeplex.com\/
\nCompression time: 00:00:00.6303679, compressed size: 41,926.00
\nDecompression time: 00:00:00.1364594<\/p>\n
Ez se az igazi sebess\u00e9gben, de legal\u00e1bb j\u00f3l t\u00f6m\u00f6r\u00edt.<\/p>\n
Lz4Native:
\nhttps:\/\/code.google.com\/p\/lz4-net\/
\nCompression time: 00:00:00.0925361, compressed size: 49,862.00
\nDecompression time: 00:00:00.1757730<\/p>\n
Na, ez m\u00e1r tetszik. Jobban t\u00f6m\u00f6r\u00edtett, mint a gzip, fele annyi id\u0151 alatt, mint az, \u00e9s a decompress is egy kicsit gyorsabb. Kipr\u00f3b\u00e1lom majd igazi adatokkal is, megl\u00e1tjuk, ott hogy zen\u00e9l.<\/p>\n","protected":false},"excerpt":{"rendered":"
A backtesteremben nagyon sok adatot kell kezelni mem\u00f3ri\u00e1ban, sok gigab\u00e1jtot. A mem\u00f3riacache-emben t\u00f6m\u00f6r\u00edtve vannak az adatok. T\u00f6m\u00f6r\u00edt\u00e9sre eddig a .NET GZip algoritmus\u00e1t…<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[8,4],"tags":[],"class_list":["post-1864","post","type-post","status-publish","format-standard","hentry","category-net","category-szakmai-elet"],"_links":{"self":[{"href":"https:\/\/soci.hu\/blog\/index.php\/wp-json\/wp\/v2\/posts\/1864","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/soci.hu\/blog\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/soci.hu\/blog\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/soci.hu\/blog\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/soci.hu\/blog\/index.php\/wp-json\/wp\/v2\/comments?post=1864"}],"version-history":[{"count":1,"href":"https:\/\/soci.hu\/blog\/index.php\/wp-json\/wp\/v2\/posts\/1864\/revisions"}],"predecessor-version":[{"id":1865,"href":"https:\/\/soci.hu\/blog\/index.php\/wp-json\/wp\/v2\/posts\/1864\/revisions\/1865"}],"wp:attachment":[{"href":"https:\/\/soci.hu\/blog\/index.php\/wp-json\/wp\/v2\/media?parent=1864"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/soci.hu\/blog\/index.php\/wp-json\/wp\/v2\/categories?post=1864"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/soci.hu\/blog\/index.php\/wp-json\/wp\/v2\/tags?post=1864"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}