Zlib – a spiffy yet delicately unobtrusive compression library

1. ZLib

   1 51 6,258 9.3 C

   A massively spiffy yet delicately unobtrusive compression library.

   

   I feel obliged to point this out here:

   Do not build zlib with the optimized assembly code.

   The "hand-optimized" assembly code is a contribution and does not receive support by the library authors. There are bugs in there and it will read/write out of bounds given just the right data - we've been bit by it. Note [0].

   The Makefiles get this right - they stay far away from any hand-rolled assembly. But the contributed Visual Studio solutions default to building with the ASM: [1] [2]. *Make sure to choose Debug/ReleaseWithoutAsm.

   You can check any zlib build for whether it was built with ASM via (zlibCompileFlags() & (1 << 9)): [3]

   Needless to say, an OOB in a library as fundamental (and as user-data-facing) as zlib is a serious vulnerability. We didn't find any distribution or major software that uses a vulnerable zlib build, but if you are on Windows you might accidentally make one. Beware!

   [0]: https://github.com/madler/zlib/blob/master/inffast.c#L12

   [1]: https://github.com/madler/zlib/blob/cacf7f1d4e3d44d871b605da...

   [2]: https://github.com/madler/zlib/blob/cacf7f1d4e3d44d871b605da...

   [3]: https://github.com/madler/zlib/blob/cacf7f1d4e3d44d871b605da...

2. InfluxDB

   www.influxdata.com featured

   InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.

   

3. zlib

   2 1 132 0.0 C

   

4. zlib

   3 4 694 4.6 C

   Cloudflare fork of zlib with massive performance improvements (by cloudflare)

   

5. zlib-ng

   4 19 1,814 9.0 C

   zlib replacement with optimizations for "next generation" systems.

   

6. libdeflate

   5 7 1,134 7.4 C

   Heavily optimized library for DEFLATE/zlib/gzip compression and decompression

   

   Going away from Zlib proper but staying with its format, there’s libdeflate[1], an implementation that’s substantially faster on modern machines but can’t stream, and of course Zopfli[2], a glacially slow compressor that’s somewhat better (and occasionally much more so).

   [1] https://github.com/ebiggers/libdeflate

   [2] https://github.com/google/zopfli

7. Stream

   getstream.io featured

   Stream - Scalable APIs for Chat, Feeds, Moderation, & Video. Stream helps developers build engaging apps that scale to millions with performant and flexible Chat, Feeds, Moderation, and Video APIs and SDKs powered by a global edge network and enterprise-grade infrastructure.

   

Suggest a related project