C Compression

Open-source C projects categorized as Compression
C Zlib Gzip Library Zstd

Top 23 C Compression Projects

Compression
  • zstd

    Zstandard - Fast real-time compression algorithm

  • Project mention: MLow: Meta's low bitrate audio codec | news.ycombinator.com | 2024-06-13

    Zstd is a personal project? Surely it's not by accident in the Facebook GitHub organization? And that you need to sign a contract on code.facebook.com before they'll consider merging any contributions? That seems like an odd claim, unless it used to be a personal project and Facebook took it over

    (https://github.com/facebook/zstd/blob/dev/CONTRIBUTING.md#co...)

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • LZ4

    Extremely Fast Compression algorithm

  • ZLib

    A massively spiffy yet delicately unobtrusive compression library.

  • Project mention: Zlib 1.3.1 Out | news.ycombinator.com | 2024-01-22
  • cute_headers

    Collection of cross-platform one-file C/C++ libraries with no dependencies, primarily used for games

  • opus

    Modern audio compression for the internet.

  • Project mention: TSAC: Low Bitrate Audio Compression | news.ycombinator.com | 2024-04-08

    Opus doesn't support 44.1 kHz because compatibility and effort/benefit ratio:

    https://github.com/xiph/opus/issues/43

    The browser audio limitation is presumably a workaround to some bug or performance limitation that was relevant at some point in history (the site was created in 2014).

  • LZFSE

    LZFSE compression library and command line tool

  • cstore_fdw

    Columnar storage extension for Postgres built as a foreign data wrapper. Check out https://github.com/citusdata/citus for a modernized columnar storage implementation built as a table access method.

  • Project mention: Moving a Billion Postgres Rows on a $100 Budget | news.ycombinator.com | 2024-02-21

    Columnar store PostgreSQL extension exists, here are two but I think I’m missing at least another one:

    https://github.com/citusdata/cstore_fdw

    https://github.com/hydradatabase/hydra

    You can also connect other stores using the foreign data wrappers, like parquet files stored on an object store, duckdb, clickhouse… though the joins aren’t optimised as PostgreSQL would do full scan on the external table when joining.

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  • zlib-ng

    zlib replacement with optimizations for "next generation" systems.

  • Project mention: Show HN: Pzip- blazing fast concurrent zip archiver and extractor | news.ycombinator.com | 2023-09-24

    Please note that allowing for 2% bigger resulting file could mean huge speedup in these circumstances even with the same compression routines, seeing these benchmarks of zlib and zlib-ng for different compression levels:

    https://github.com/zlib-ng/zlib-ng/discussions/871

    IMO the fair comparison of the real speed improvement brought by a new program is only between the almost identical resulting compressed sizes.

  • zip

    A portable, simple zip library written in C (by kuba--)

  • FiniteStateEntropy

    New generation entropy codecs : Finite State Entropy and Huff0

  • Project mention: Intel QuickAssist Technology Zstandard Plugin for Zstandard | news.ycombinator.com | 2023-08-16

    It's obsolete. It's limited to 32KB LZ window with huffman coding. Zstd can use a much larger window (8MB recommended) and a much better entropy coder: https://github.com/Cyan4973/FiniteStateEntropy

  • Minizip-ng

    Fork of the popular zip manipulation library found in the zlib distribution.

  • smaz

    Small strings compression library

  • astc-encoder

    The Arm ASTC Encoder, a compressor for the Adaptive Scalable Texture Compression data format.

  • c-blosc

    A blocking, shuffling and loss-less compression library that can be faster than `memcpy()`.

  • lzbench

    lzbench is an in-memory benchmark of open-source LZ77/LZSS/LZMA compressors

  • Project mention: Chrome Feature: ZSTD Content-Encoding | news.ycombinator.com | 2024-04-01

    For a benchmark on a standard set: https://github.com/inikep/lzbench/blob/master/lzbench18_sort...

  • p7zip

    A new p7zip fork with additional codecs and improvements (forked from https://sourceforge.net/projects/sevenzip/ AND https://sourceforge.net/projects/p7zip/).

  • TurboPFor

    Fastest Integer Compression

  • Project mention: Show HN: Time Series Benchmark TurboPFor,TurboFloat,TurboFloat LzX,TurboGorilla | news.ycombinator.com | 2023-06-25
  • squashfs-tools

    tools to create and extract Squashfs filesystems

  • bzip3

    A better and stronger spiritual successor to BZip2.

  • Project mention: Bzip2 Format Specification [pdf] | news.ycombinator.com | 2024-04-10

    Kamila Szewczyk is working on a bzip3 to improve the state-of-the-art in the domain of compressors based on Burrows-Wheeler:

    https://github.com/kspalaiologos/bzip3

    I’m keeping fingers crossed for the project. Especially given that the author is 19 and her best work is yet to come.

  • lizard

    Lizard (formerly LZ5) is an efficient compressor with very fast decompression. It achieves compression ratio that is comparable to zip/zlib and zstd/brotli (at low and medium compression levels) at decompression speed of 1000 MB/s and faster. (by inikep)

  • zson

    ZSON is a PostgreSQL extension for transparent JSONB compression

  • simdcomp

    A simple C library for compressing lists of integers using binary packing

  • gozstd

    go wrapper for zstd

  • Project mention: Chrome Feature: ZSTD Content-Encoding | news.ycombinator.com | 2024-04-01
  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

C Compression discussion

Log in or Post with

C Compression related posts

  • MLow: Meta's low bitrate audio codec

    1 project | news.ycombinator.com | 13 Jun 2024
  • My First Arch Linux Installation

    3 projects | dev.to | 12 Jun 2024
  • LuaRT 1.8.0 – open-source Windows programming framework for Lua

    2 projects | news.ycombinator.com | 22 May 2024
  • Ask HN: Why are people so mean in the open source community? (about xz again)

    1 project | news.ycombinator.com | 18 May 2024
  • VDO: Userspace tools for pools of deduplicated and compressed block storage

    1 project | news.ycombinator.com | 14 May 2024
  • Rethinking string encoding: a 37.5% space efficient encoding than UTF-8 in Fury

    2 projects | news.ycombinator.com | 7 May 2024
  • Drink Me: (Ab)Using a LLM to Compress Text

    2 projects | news.ycombinator.com | 4 May 2024
  • A note from our sponsor - SaaSHub
    www.saashub.com | 22 Jun 2024
    SaaSHub helps you find the best software and product alternatives Learn more →

Index

What are some of the best open-source Compression projects in C? This list will help you:

Project Stars
1 zstd 22,690
2 LZ4 9,381
3 ZLib 5,408
4 cute_headers 4,157
5 opus 2,160
6 LZFSE 1,759
7 cstore_fdw 1,749
8 zlib-ng 1,463
9 zip 1,341
10 FiniteStateEntropy 1,297
11 Minizip-ng 1,189
12 smaz 1,131
13 astc-encoder 1,005
14 c-blosc 968
15 lzbench 852
16 p7zip 756
17 TurboPFor 749
18 squashfs-tools 727
19 bzip3 651
20 lizard 639
21 zson 527
22 simdcomp 476
23 gozstd 420

Sponsored
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com