lib842
FiniteStateEntropy
lib842 | FiniteStateEntropy | |
---|---|---|
1 | 4 | |
4 | 1,263 | |
- | - | |
10.0 | 0.0 | |
over 1 year ago | over 1 year ago | |
C | C | |
GNU Lesser General Public License v3.0 only | BSD 2-clause "Simplified" License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
lib842
FiniteStateEntropy
-
Intel QuickAssist Technology Zstandard Plugin for Zstandard
It's obsolete. It's limited to 32KB LZ window with huffman coding. Zstd can use a much larger window (8MB recommended) and a much better entropy coder: https://github.com/Cyan4973/FiniteStateEntropy
-
Worries about tANS?
tANS block based : FSE
-
Silly Lossy Text Compression Idea
Sounds similar to: https://github.com/Cyan4973/FiniteStateEntropy
https://arxiv.org/abs/1311.2540
> The modern data compression is mainly based on two approaches to entropy coding: Huffman (HC) and arithmetic/range coding (AC). The former is much faster, but approximates probabilities with powers of 2, usually leading to relatively low compression rates. The latter uses nearly exact probabilities - easily approaching theoretical compression rate limit (Shannon entropy), but at cost of much larger computational cost.
-
C Deep
FiniteStateEntropy - Two highly efficient compression codecs optimized for modern CPUs. BSD-2-Clause
What are some alternatives?
TurboBench - Compression Benchmark
Snappy - A fast compressor/decompressor
isa-l - Intelligent Storage Acceleration Library
zstd - Zstandard - Fast real-time compression algorithm
QATzip - Compression Library accelerated by IntelĀ® QuickAssist Technology
zlib-ng - zlib replacement with optimizations for "next generation" systems.
qatlib
brotli - Brotli compression format
QAT-ZSTD-Plugin
LZFSE - LZFSE compression library and command line tool
LZMA - (Unofficial) Git mirror of LZMA SDK releases