Intel QuickAssist Technology Zstandard Plugin for Zstandard

• zlib-ng

  13 1,440 9.4 C

  zlib replacement with optimizations for "next generation" systems.

  

• qatlib

  2 82 4.8 C
  

https://github.com/intel/qatlib/blob/main/quickassist/includ...

It also seems to suggest that it could accelerate hyperscan, but considering the hardware and software are both from Intel and they don't integrate them, maybe it doesn't work or is theoretical.

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• QAT-ZSTD-Plugin

  2 53 6.4 C
  

Interesting that Intel's code for this includes numerous references to LZ4, as if that's the actual algorithm the hardware originally aimed to accelerate.. So seems like LZ4 and ZSTD are quite similar?

https://github.com/intel/QAT-ZSTD-Plugin/blob/main/src/qatse...

• isa-l

  5 904 8.6 C

  Intelligent Storage Acceleration Library

  

For using accelerators (QAT, I assume, because the article is about this) from the CLI, then QATzip[3] comes with a command line tool qatzip which can be used as described in the project ReadMe. I didn't test it, though, as I have no QAT-enabled device.

[1] https://github.com/intel/isa-l/tree/master/igzip

• rapidgzip

  14 314 9.6 C++

  Gzip Decompression and Random Access for Modern Multi-Core Machines

• QATzip

  1 129 7.4 C

  Compression Library accelerated by Intel® QuickAssist Technology

  

• TurboBench

  10 310 8.9 C

  Compression Benchmark

- https://github.com/powturbo/TurboBench/issues/43

[1] https://github.com/powturbo/TurboBench

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• FiniteStateEntropy

  4 1,263 0.0 C

  New generation entropy codecs : Finite State Entropy and Huff0

It's obsolete. It's limited to 32KB LZ window with huffman coding. Zstd can use a much larger window (8MB recommended) and a much better entropy coder: https://github.com/Cyan4973/FiniteStateEntropy

• lib842

  1 4 10.0 C

Suggest a related project