SaaSHub helps you find the best software and product alternatives Learn more →
C inflate Projects
-
For what it’s worth, the benchmark on the Zstandard homepage[1] shows none of the compressors tested breaking 1GB/s on compression, and only the fastest and sloppiest ones breaking 1GB/s on decompression. If you’re OK with its API limitations, libdeflate[2] is known to squeeze past 1GB/s decompressing normal Deflate compression levels. So asking for multiple GB/s is probably unfair.
Still, 10MB/s sounds like the absolute minimum reasonable speed, and they’re reporting nearly three orders of magnitude below that. A modern compressor does not run at bad dialup speeds; something in there is absolutely murdering the performance.
And it might just be the constant-time overhead, as far as I can see. The article mentions “a few hundred bytes” of payload, and the discussion of measurements implies 1.5KB uncompressed. Even though they don’t reinitialize the compressor on each message, that is still a very very modest amount of data.
So it might be that general-purpose compressors are just a bad tool here from a performance standpoint. I’m not aware of a good tool for this kind of application, though.
[1] https://facebook.github.io/zstd/#benchmarks
[2] https://github.com/zlib-ng/zlib-ng/issues/1486
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
C inflate discussion
C inflate related posts
-
Discord Reduced WebSocket Traffic by 40%
-
Show HN: Pzip- blazing fast concurrent zip archiver and extractor
-
Introducing zune-inflate: The fastest Rust implementation of gzip/Zlib/DEFLATE
-
Computing Adler32 Checksums at 41 GB/s
-
Re: Zlib memory corruption on deflate (i.e. compress)
-
Zlib – a spiffy yet delicately unobtrusive compression library
-
Release 2.0.0 - First stable release · zlib-ng/zlib-ng
-
A note from our sponsor - SaaSHub
www.saashub.com | 15 Oct 2024
Index
| Project | Stars | |
|---|---|---|
| 1 | zlib-ng | 1,564 |
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com