QATzip
FiniteStateEntropy
QATzip | FiniteStateEntropy | |
---|---|---|
1 | 4 | |
130 | 1,263 | |
0.0% | - | |
7.4 | 0.0 | |
3 months ago | over 1 year ago | |
C | C | |
GNU General Public License v3.0 or later | BSD 2-clause "Simplified" License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
QATzip
FiniteStateEntropy
-
Intel QuickAssist Technology Zstandard Plugin for Zstandard
It's obsolete. It's limited to 32KB LZ window with huffman coding. Zstd can use a much larger window (8MB recommended) and a much better entropy coder: https://github.com/Cyan4973/FiniteStateEntropy
-
Worries about tANS?
tANS block based : FSE
-
Silly Lossy Text Compression Idea
Sounds similar to: https://github.com/Cyan4973/FiniteStateEntropy
https://arxiv.org/abs/1311.2540
> The modern data compression is mainly based on two approaches to entropy coding: Huffman (HC) and arithmetic/range coding (AC). The former is much faster, but approximates probabilities with powers of 2, usually leading to relatively low compression rates. The latter uses nearly exact probabilities - easily approaching theoretical compression rate limit (Shannon entropy), but at cost of much larger computational cost.
-
C Deep
FiniteStateEntropy - Two highly efficient compression codecs optimized for modern CPUs. BSD-2-Clause
What are some alternatives?
rapidgzip - Gzip Decompression and Random Access for Modern Multi-Core Machines
Snappy - A fast compressor/decompressor
qatlib
zstd - Zstandard - Fast real-time compression algorithm
QAT-ZSTD-Plugin
zlib-ng - zlib replacement with optimizations for "next generation" systems.
isa-l - Intelligent Storage Acceleration Library
brotli - Brotli compression format
TurboBench - Compression Benchmark
LZFSE - LZFSE compression library and command line tool
lib842
LZMA - (Unofficial) Git mirror of LZMA SDK releases