Lizard – efficient compression with fast decompression

• lizard

  4 633 0.0 C

  Lizard (formerly LZ5) is an efficient compressor with very fast decompression. It achieves compression ratio that is comparable to zip/zlib and zstd/brotli (at low and medium compression levels) at decompression speed of 1000 MB/s and faster. (by inikep)

• lzbench

  9 836 1.9 C

  lzbench is an in-memory benchmark of open-source LZ77/LZSS/LZMA compressors

Note that a benchmark in the README refers to zstd 1.1.1 and brotli 0.5.2, which are very old (the current versions are zstd 1.5.2 and brotli 1.0.9). The same author maintains lzbench [1], which is more or less up-to-date.

[1] https://github.com/inikep/lzbench

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• zstd

  105 22,356 9.7 C

  Zstandard - Fast real-time compression algorithm

  

The thing I don't get about zstd is that their own github page shows lz4 is faster at both compression and decompression at the cost of some compression ratio: https://github.com/facebook/zstd

But most people I work with will pick zstd every time even in cases where decompression speed matters the most.

• qemu

  37 - -

From https://btrfs.wiki.kernel.org/index.php/Compression

> Btrfs supports transparent file compression. There are three algorithms available: ZLIB, LZO and ZSTD(since v4.14)

I've been using zstd compression for qcow2 images since last year, but I admit it's kind of hidden. The man page for qemu-img [1] doesn't say a word about zstd, but it's there alright [2].

[1]: https://www.qemu.org/docs/master/tools/qemu-img.html

[2]: https://gitlab.com/qemu-project/qemu/-/blob/v7.0.0/block/qco...

Suggest a related project