AWS switch from gzip to zstd – about 30% reduction in compressed S3 storage

• preflate

  2 33 10.0 C++

  deflate stream reconstruction library

  There are tools like preflate [1] or precomp [2] that guarantees a bitwise identical reconstruction, of course modulo bugs.

  [1] https://github.com/deus-libri/preflate

  [2] https://github.com/schnaader/precomp-cpp/ (which internally makes use of preflate)

• precomp-cpp

  14 387 0.0 C

  Precomp, C++ version - further compress already compressed files

  There are tools like preflate [1] or precomp [2] that guarantees a bitwise identical reconstruction, of course modulo bugs.

  [1] https://github.com/deus-libri/preflate

  [2] https://github.com/schnaader/precomp-cpp/ (which internally makes use of preflate)

• InfluxDB

  www.influxdata.com

  sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• vdo

  9 188 1.3 C

  Userspace tools for managing VDO volumes.

  

• zstd

  105 22,293 9.6 C

  Zstandard - Fast real-time compression algorithm

  

• minio

  99 44,094 9.9 Go

  The Object Store for AI Data Infrastructure

  

• WorkOS

  workos.com

  sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

Suggest a related project