libdeflate
qoir
Our great sponsors
| libdeflate | qoir | |
|---|---|---|
| 7 | 3 | |
| 931 | 94 | |
| - | - | |
| 8.8 | 0.7 | |
| 15 days ago | about 1 year ago | |
| C | C | |
| MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
libdeflate
- Ebiggers/libdeflate: Heavily optimized DEFLATE/zlib/gzip library
-
Introducing zune-inflate: The fastest Rust implementation of gzip/Zlib/DEFLATE
zune-inflate is a port of libdeflate to safe Rust.
-
Quite OK Image is now my favorite asset format
> The QOI benchmarks shows it only lagging a small bit behind PNG in compression ratio, while performing much faster (multiples) in both encoding and decoding.
Presumably that’s with stock libpng, which uses zlib. I wonder if anyone tried patching it to use the substantially faster (on x86) libdeflate[1] instead? It doesn’t do streaming, but you shouldn’t really need it for PNG textures.
[1] https://github.com/ebiggers/libdeflate
-
bitter v0.6 - the performant bit reading library with a new faster API
Eric biggers libdeflate https://github.com/ebiggers/libdeflate/blob/master/lib/deflate_decompress.c
-
Computing Adler32 Checksums at 41 GB/s
Note that libdeflate has used essentially the same method since 2016 (https://github.com/ebiggers/libdeflate/blob/v0.4/lib/adler32...), though I recently switched it to use a slightly different method (https://github.com/ebiggers/libdeflate/blob/v1.12/lib/x86/ad...) that performs more consistently across different families of x86 CPUs.
-
Zlib – a spiffy yet delicately unobtrusive compression library
Going away from Zlib proper but staying with its format, there’s libdeflate[1], an implementation that’s substantially faster on modern machines but can’t stream, and of course Zopfli[2], a glacially slow compressor that’s somewhat better (and occasionally much more so).
[1] https://github.com/ebiggers/libdeflate
[2] https://github.com/google/zopfli
- Firefox's Optimized Zip Format: Reading Zip Files Quickly
qoir
-
The Near-Lossless Image Formats Using Ultra-Fast LZ Codecs
It's important to notice that ZPNG beats virtually all QOI variants, as discovered in: https://github.com/nigeltao/qoir
-
Hello, PNG
But most platforms these days have some form of CRC32 "acceleration". Adler32 is easy to compute so I'm even less concerned there.
I spent a bunch of time optimising the code in [fpnge](https://github.com/veluca93/fpnge), which is [often notably faster than fpng](https://github.com/nigeltao/qoir/blob/5671f584dcf84ddb71e28d...), yet checksum time is basically negligible.
Having said that, the double-checksum aspect of PNG does feel unnecessary.
-
Quite OK Image is now my favorite asset format
* AFAIK it does this while beating the original QOI in terms of speed AND efficiency
Lots of benchmarks in: https://github.com/nigeltao/qoir
QOIX
QOIX is my very own version that adds:
What are some alternatives?
zlib-ng - zlib replacement with optimizations for "next generation" systems.
CompactGUI - Transparently compress active games and programs using Windows 10/11 APIs
ZLib - A massively spiffy yet delicately unobtrusive compression library.
qoipond - Lossless image format inspired by QOI “Quite OK Image” format
zlib - Cloudflare fork of zlib with massive performance improvements
tinf - Tiny inflate library (inflate, gzip, zlib)
zlib
fpng - Super fast C++ .PNG writer/reader
figlet-fonts - my collection of figlet / toilet ascii art fonts
HexFiend - A fast and clever hex editor for macOS
fpnge - Demo of a fast PNG encoder.