Chrome Feature: ZSTD Content-Encoding

• zstd

  106 22,407 9.7 C

  Zstandard - Fast real-time compression algorithm

  

Of course, you may get different results with another dataset.

gzip (zlib -6) [ratio=32%] [compr=35Mo/s] [dec=407Mo/s]

zstd (zstd -2) [ratio=32%] [compr=356Mo/s] [dec=1067Mo/s]

NB1: The default for zstd is -3, but the table only had -2. The difference is probably small. The range is 1-22 for zstd and 1-9 for gzip.

NB2: The default program for gzip (at least with Debian) is the executable from zlib. With my workflows, libdeflate-gzip iscompatible and noticably faster.

NB3: This benchmark is 2 years old. The latest releases of zstd are much better, see https://github.com/facebook/zstd/releases

For a high compression, according to this benchmark xz can do slightly better, if you're willing to pay a 10× penalty on decompression.

xz -9 [ratio=23%] [compr=2.6Mo/s] [dec=88Mo/s]

zstd -9 [ratio=23%] [compr=2.6Mo/s] [dec=88Mo/s]

• substrata

  7 24 9.7 C++

  open-source metaverse

  

I implemented this in my server (https://substrata.info/). Works great. Results in smaller files than zlib/deflate.

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• .NET Runtime

  608 14,091 10.0 C#

  .NET is a cross-platform runtime for cloud, mobile, desktop, and IoT apps.

  

https://github.com/dotnet/runtime/issues/59591

Support zstd Content-Encoding:

• ASP.NET Core

  1,632 34,357 9.9 C#

  ASP.NET Core is a cross-platform .NET framework for building modern cloud-based web applications on Windows, Mac, or Linux.

  

https://github.com/dotnet/aspnetcore/issues/50643

• lzbench

  9 842 1.9 C

  lzbench is an in-memory benchmark of open-source LZ77/LZSS/LZMA compressors

For a benchmark on a standard set: https://github.com/inikep/lzbench/blob/master/lzbench18_sort...

• gozstd

  1 412 2.2 C

  go wrapper for zstd

• compress

  17 4,506 8.4 Go

  Optimized Go Compression Packages

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project