[BBLISA] Compression Algorithms

[Brian O'Neill]

Check out "lzma" (pretty widely available) and "xz" (new version). They 
are by no means fast, but seem faster than 7-zip, can be used inline, 
and give better results than bzip2. However, I've had some data files 
that make lzma/xz atrociously slow...

On 6/29/2010 9:15 AM, Edward Ned Harvey wrote:
> I decided to benchmark some compression algorithms on our actual data.
> Results are attached.
>
> Summary:
>
> · LZO is the fastest.
>
> · 7-zip (p7zip) produces the best compression ratio. (Overall, it's the
> most impressive.) Doesn't seem possible to use it as an in-line filter.
>
> · gzip --fast is the most widely available. Its speed is same order of
> magnitude with LZO, and its compression is same order of magnitude as
> 7-zip, but it's unquestionably beat by those others, in their natural
> habitat. So for general purpose, gzip --fast is the most likely to be
> used in general.
>
> · bzip2 is soundly destroyed by 7-zip, if only 7-zip is made available
> as an in-line filter. Presently, in-line filtering is the only reason to
> ever use bzip2 instead of 7-zip.
>
>
>
> _______________________________________________
> bblisa mailing list
> bblisa at bblisa.org
> http://www.bblisa.org/mailman/listinfo/bblisa