Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →
Top 12 Huffman Open-Source Projects
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
Huffman-Coding
A C++ compression program based on Huffman's lossless compression algorithm and decoder.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
JPEG-Image-Compressor
A Python program that compresses raw images based on the JPEG compression algorithm.
Project mention: Intel QuickAssist Technology Zstandard Plugin for Zstandard | news.ycombinator.com | 2023-08-16It's obsolete. It's limited to 32KB LZ window with huffman coding. Zstd can use a much larger window (8MB recommended) and a much better entropy coder: https://github.com/Cyan4973/FiniteStateEntropy
Project mention: The long road to recover Frogger 2 source from tape drives | news.ycombinator.com | 2023-05-24Are they really JPEGs and MP3s, or just bitrot?
I've found https://github.com/ImpulseAdventure/JPEGsnoop useful to fix corruption but I haven't come across a non-standard JFIF JPEG unless it was intentionally designed to accommodate non-standard features (alpha channel etc).
Project mention: Zstd Content-Encoding planned to ship with Chrome 123 | news.ycombinator.com | 2024-02-07I'm still unconvinced about this addition. And I don't even dislike Zstandard.
The main motivation seems to be that while Zstandard is worse than Brotli at the highest level, it's substantially faster than Brotli when data has to be compressed on the fly with a limited computation budget. That might be true, but I'm yet to see any concrete or even anecdotal evidence even in the issue tracker [1] while there exist some benchmarks where both Zstandard and Brotli are fast enough for the web usage even at lower levels [2].
According to their FAQ [3] Meta and Akamai have successfully used Zstandard in their internal network, but my gut feeling is that they never actually tried to optimize Brotli instead. In fact, Meta employs the main author of Zstandard so it would have been easier to tune Zstandard instead of Brotli. While Brotli has some fundamental difference from Zstandard (in particular Brotli doesn't use arithmetic-equivalent coding), no one has concretely demonstrated that difference would prevent Brotli from being fast enough for dynamic contents in my opinion.
[1] https://issues.chromium.org/issues/40196713
[2] https://github.com/powturbo/TurboBench/issues/43
[3] https://docs.google.com/document/d/14dbzMpsYPfkefAJos124uPrl...
Huffman related posts
-
Intel QuickAssist Technology Zstandard Plugin for Zstandard
-
Worries about tANS?
-
Silly Lossy Text Compression Idea
-
Self Made Zip - File archiver and archive extractor programs based on Huffman’s lossless compression algorithm
-
Self Made Zip - File archiver and archive extractor programs based on Huffman’s lossless compression algorithm
-
Huffman decompression
-
A note from our sponsor - InfluxDB
www.influxdata.com | 7 May 2024
Index
What are some of the best open-source Huffman projects? This list will help you:
Project | Stars | |
---|---|---|
1 | FiniteStateEntropy | 1,263 |
2 | JPEGsnoop | 487 |
3 | 3dstool | 314 |
4 | TurboBench | 312 |
5 | kanzi | 96 |
6 | Huffman-Coding | 95 |
7 | kanzi-cpp | 87 |
8 | JPEG-Image-Compressor | 38 |
9 | pico-png | 15 |
10 | zune-entropy | 8 |
11 | httlib-rs | 6 |
12 | huffman-c | 0 |
Sponsored