WASM compression benchmarks and the cost of missing compression APIs

• c-blosc

  1 958 5.7 C

  A blocking, shuffling and loss-less compression library that can be faster than `memcpy()`.

  

Related to compressing data before storing on SSD:

Blosc - faster than memcpy()

https://github.com/Blosc/c-blosc

On right circumstances Blosc is so fast that even speed ups reading data from RAM (read less, decompress in L1 and L2 caches)

• mashi

  1 12 10.0 Rust

  A Rust no-std (de)compressor based on PAQ

  

Just to add a data point, I've written a tiny Rust library [0] that can compile to WASM, that is quite effective for smaller payloads. It is based on PAQ so memory usage explodes a bit once you start compressing large files, but on smaller files it is super competitive.

[0] https://github.com/datatrash/mashi

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project