zstd
LZFSE
Our great sponsors
zstd | LZFSE | |
---|---|---|
61 | 1 | |
17,386 | 1,682 | |
1.5% | 0.4% | |
9.5 | 0.0 | |
4 days ago | 2 months ago | |
C | C | |
GNU General Public License v3.0 or later | BSD 3-clause "New" or "Revised" License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
zstd
- Convenient CPU feature detection and dispatch in the Magnum Engine
-
Xz format considered inadequate for long-term archiving
zstd still doesn't have a seekable format as part of the official standard (I wish it did): https://github.com/facebook/zstd/issues/395#issuecomment-535...
- Compressing Huge Files..
-
PSA: ZSTD compression is broken (very slow), here's how to fix it
Look at the pull request in that bug: https://github.com/facebook/zstd/pull/3165
-
The Bizarre Case of Zstd's Slow Performance on Arch Linux
zstd normally uses timespec_get() for measuring wall-clock time. But that's available only since C11. For older standards, it uses clock(), but that returns CPU time, which is wrong.
-
Lizard – efficient compression with fast decompression
The thing I don't get about zstd is that their own github page shows lz4 is faster at both compression and decompression at the cost of some compression ratio: https://github.com/facebook/zstd
But most people I work with will pick zstd every time even in cases where decompression speed matters the most.
-
Zstandard Worked Example
https://github.com/facebook/zstd/tree/dev/doc/educational_de... is a self-contained zstd decoder. I get a 64 KB dynamically linked executable after running "make" in that directory.
$ size harness
> Yikes; half a meg of code!
It's plausible that the lib you checked is the output from the project's default build target (zstd), which "(...) uncludes dictionary builder, benchmark, and supports decompression of legacy zstd formats"
https://github.com/facebook/zstd/tree/dev/programs
The project also provides another build target, zstd-small, which is "CLI optimized for minimal size; no dictionary builder, no benchmark, and no support for legacy zstd formats"
Also, take a look at what exactly is bundled with the binary.
LZFSE
-
Why is Zip preferred on Mac while RAR seems like the favorite on Windows?
I'm not entirely correct, though. Because Unarchiver likely uses this compression algorithm by calling directly into the API. And there is an open-source implementation for it: lzfse/lzfse.
What are some alternatives?
LZ4 - Extremely Fast Compression algorithm
Snappy - A fast compressor/decompressor
LZMA - (Unofficial) Git mirror of LZMA SDK releases
7-Zip-zstd - 7-Zip with support for Brotli, Fast-LZMA2, Lizard, LZ4, LZ5 and Zstandard
ZLib - A massively spiffy yet delicately unobtrusive compression library.
brotli - Brotli compression format
zfs - OpenZFS on Linux and FreeBSD
LZHAM - Lossless data compression codec with LZMA-like ratios but 1.5x-8x faster decompression speed, C/C++
zlib - Cloudflare fork of zlib with massive performance improvements
zlib-ng - zlib replacement with optimizations for "next generation" systems.
rsync - An open source utility that provides fast incremental file transfer. It also has useful features for backup and restore operations among many other use cases.