zstd

1. zstd

   1 120 24,555 9.8 C

   Zstandard - Fast real-time compression algorithm

   

   They have a nice table on that page: https://github.com/facebook/zstd#benchmarks

   Looking at that table, I think LZ4 is a winner. The compression ratio is not too far, compression speed is slightly faster, decompression speed is significantly faster, the code is much simpler so the compiled binary is smaller, and the project is unrelated to Facebook.

2. CodeRabbit

   coderabbit.ai featured

   CodeRabbit: AI Code Reviews for Developers. Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.

   

3. zstd-proxy

   2 1 78 10.0 C

   High-performance real-time TCP compression

   

   I needed to compress a TCP stream [0] for a block-storage project and I've been very impressed with zstd. Combined with io_uring, I'm getting less CPU usage and higher throughput to send and compress data than using socat to send uncompressed data.

   [0]: https://github.com/fathyb/zstd-proxy

4. sqlite-zstd

   3 11 1,514 6.5 Rust

   Transparent dictionary-based row-level compression for SQLite

   

5. LZ4

   4 24 10,732 9.0 C

   Extremely Fast Compression algorithm

   

   > The downside of lz4 is that it can’t be configured to run at higher & slower compression ratios.

   lz4 has some level of configurability? https://github.com/lz4/lz4/blob/v1.9.4/lib/lz4frame.h#L194

   There's also LZ4_HC.

6. compress

   5 18 4,948 8.0 Go

   Optimized Go Compression Packages

   

   There is a reasonably feature complete implementation of Zstd for Go: https://github.com/klauspost/compress/tree/master/zstd

   It may not offer the same API 1:1, but it has no interoperability issues that I've encountered. So, I just think no one has bothered to implement it in Rust because most use cases don't mind the added bloat you're talking about. Plus, other comments I've seen suggest that you can actually tune the size of the zstd library, although I'm not sure if the Rust bindings expose that.

7. PeaZip

   6 71 4,871 9.3 Pascal

   Free Zip / Unzip software and Rar file extractor. Cross-platform file and archive manager. Features volume spanning, compression, authenticated encryption. Supports 7Z, 7-Zip sfx, ACE, ARJ, Brotli, BZ2, CAB, CHM, CPIO, DEB, GZ, ISO, JAR, LHA/LZH, NSIS, OOo, PAQ/LPAQ, PEA, QUAD, RAR, RPM, split, TAR, Z, ZIP, ZIPX, Zstandard.

   

Suggest a related project