Intel QuickAssist Technology Zstandard Plugin for Zstandard

This page summarizes the projects mentioned and recommended in the original post on news.ycombinator.com

InfluxDB – Built for High-Performance Time Series Workloads
InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured
  1. zlib-ng

    zlib replacement with optimizations for "next generation" systems.

  2. InfluxDB

    InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.

    InfluxDB logo
  3. qatlib

    https://github.com/intel/qatlib/blob/main/quickassist/includ...

    It also seems to suggest that it could accelerate hyperscan, but considering the hardware and software are both from Intel and they don't integrate them, maybe it doesn't work or is theoretical.

  4. QAT-ZSTD-Plugin

    Interesting that Intel's code for this includes numerous references to LZ4, as if that's the actual algorithm the hardware originally aimed to accelerate.. So seems like LZ4 and ZSTD are quite similar?

    https://github.com/intel/QAT-ZSTD-Plugin/blob/main/src/qatse...

  5. isa-l

    Intelligent Storage Acceleration Library

    For using accelerators (QAT, I assume, because the article is about this) from the CLI, then QATzip[3] comes with a command line tool qatzip which can be used as described in the project ReadMe. I didn't test it, though, as I have no QAT-enabled device.

    [1] https://github.com/intel/isa-l/tree/master/igzip

  6. rapidgzip

    Gzip Decompression and Random Access for Modern Multi-Core Machines

  7. QATzip

    Compression Library accelerated by Intel® QuickAssist Technology

  8. TurboBench

    Compression Benchmark

    - https://github.com/powturbo/TurboBench/issues/43

    [1] https://github.com/powturbo/TurboBench

  9. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  10. FiniteStateEntropy

    New generation entropy codecs : Finite State Entropy and Huff0

    It's obsolete. It's limited to 32KB LZ window with huffman coding. Zstd can use a much larger window (8MB recommended) and a much better entropy coder: https://github.com/Cyan4973/FiniteStateEntropy

  11. lib842

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • zlib-ng: zlib replacement with optimizations for "next generation" systems

    2 projects | news.ycombinator.com | 16 Mar 2025
  • Discord Reduced WebSocket Traffic by 40%

    2 projects | news.ycombinator.com | 20 Sep 2024
  • Ask HN: Why are people so mean in the open source community? (about xz again)

    1 project | news.ycombinator.com | 18 May 2024
  • Xz: Update maintainer and author info. The other maintainer suddenly disappeared

    1 project | news.ycombinator.com | 12 Apr 2024
  • Thanks Andres Freud

    1 project | news.ycombinator.com | 9 Apr 2024