Top 23 C Compression Projects
Zstandard - Fast real-time compression algorithmProject mention: news.ycombinator.com | 2021-02-21
and speed the table building up by about ~2x . This is insignificant for large decompressions, but if you're decompressing only a few KB, the table building time can dominate the actual decompression.
It sort of goes to show that while Huffman codes have been around for ages, implementations can still improve, especially as the hardware we use changes.
Brotli compression format
Brotli - General-purpose lossless compression algorithm library. Has speeds comparable to DEFLATE, but much higher compression ratios. MIT.
Get performance insights in less than 4 minutes. Scout APM uses tracing logic that ties bottlenecks to source code so you know the exact line of code causing performance issues and can get back to building a great product faster.
Deduplicating archiver with compression and authenticated encryption.Project mention: Backing up a locally hosted Nextcloud instance | reddit.com/r/NextCloud | 2021-03-01
rsync.net (link to their borg specific backup solution which is cheaper than regular rsync.net backups) with borg backup is what I use. All data is encrypted before it ever leaves my machine with a key and passphrase that are stored locally. The data on rsync.net would be totally useless to anyone that got their hands on it.
Extremely Fast Compression algorithmProject mention: Activision warns a standard 500GB PS4 may no longer fit Call of Duty: Warzone, Black Ops Cold War and Modern Warfare | reddit.com/r/Games | 2021-02-25
Oodle Kraken and lz4 are a thing.
A massively spiffy yet delicately unobtrusive compression library.
Zlib - Massively spiffy yet delicately unobtrusive compression library. BSD-3-Clause
LZFSE compression library and command line toolProject mention: Why is Zip preferred on Mac while RAR seems like the favorite on Windows? | reddit.com/r/MacOS | 2021-01-21
I'm not entirely correct, though. Because Unarchiver likely uses this compression algorithm by calling directly into the API. And there is an open-source implementation for it: lzfse/lzfse.
Modern audio compression for the internet.Project mention: Google Duo: More reliable voice calls for more people on Android | reddit.com/r/Android | 2021-03-02
Currently, the royalty-free open-source codec Opus, is the most widely used codec for WebRTC-based VOIP applications.
New generation entropy codecs : Finite State Entropy and Huff0
FiniteStateEntropy - Two highly efficient compression codecs optimized for modern CPUs. BSD-2-Clause
Small strings compression library
smaz - Efficient string compression library. BSD-3-Clause
Fork of the popular zip manipulation library found in the zlib distribution.
zlib replacement with optimizations for "next generation" systems.
A portable, simple zip library written in C (by kuba--)
zip - Really really small zip archive processing library. Unlicense
Fastest Integer Compression
TurboPFor - Fastest integer compression. GPL-2.0-or-later
Lizard (formerly LZ5) is an efficient compressor with very fast decompression. It achieves compression ratio that is comparable to zip/zlib and zstd/brotli (at low and medium compression levels) at decompression speed of 1000 MB/s and faster.
Lizard - Formerly LZ5; an efficient compressor with fast decompression. Achieves compression ratios comparable with zip and zlib at decompression speeds of 1000MB/s and faster. BSD-2-Clause
DEFLATE, gzip, and zlib bindings for Rust
A Python wrapper for the extremely fast Blosc compression library
Precomp, C++ version - further compress already compressed filesProject mention: Help me out with some compression tips | reddit.com/r/compression | 2021-01-06
A library for some loosely related Microsoft compression formats, CAB, CHM, HLP, LIT, KWAJ and SZDD.Project mention: Protontricks, can't install Wmp11(Permission Denied). | reddit.com/r/wine_gaming | 2021-01-26
Reminds me I should get back and finally implement the symlink "fix" in cabextract I promised to do ._.
Simple Network Encrypting Backup UtilityProject mention: Pet Project Thread February 26 2021 | reddit.com/r/sysadmin | 2021-02-27
Would a mention of my open source backup system, Snebu (or https://github.com/derekp7/snebu) fit in this thread? Elevator pitch -- GPLv3 C code, snapshot-based, compresses, encrypts, deduplicates, can back up clients without installing an agent (just need ssh, bash, tar, and find commands on client for "pull" backups), push backups can have restricted permissions (i.e., give a client permission to push backups only, but not delete backups, or give a user restore-only permissions). Uses tar to collect the data, stores metadata in an SQLite DB on the server, files are stored in LZO format (can be read directly with lzop) (unless client-side encryption is used, but the data can still be decrypted with openssl then decompressed with lzop). Encryption is public-key based instead of needing to keep a shared symmetric key or passphrase laying around on your backup server.
Free open-source compressor for apLib with 5-7% better ratiosProject mention: Free open source aPLib compressor gains serious use in retrocomputing | news.ycombinator.com | 2021-01-12
libbz2 (bzip2 compression) bindings for Rust
A simple tool to extract motion vectors from h264 encoded videos.Project mention: Motion detection from video compression | reddit.com/r/computervision | 2021-01-05
look for libraries to extract motion vector from video streams. e.g. https://github.com/vadimkantorov/mpegflow or https://github.com/jishnujayakumar/MV-Tractus
FPC - Fast Prefix CoderProject mention: news.ycombinator.com | 2021-02-22
What are some of the best open-source Compression projects in C? This list will help you: