nvcomp
isa-l
nvcomp | isa-l | |
---|---|---|
7 | 5 | |
528 | 907 | |
1.7% | 1.5% | |
4.8 | 8.6 | |
7 months ago | 10 days ago | |
C++ | C | |
GNU General Public License v3.0 or later | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
nvcomp
- Pigz: Parallel gzip for modern multi-processor, multi-core machines
- GDeflate: An Open GPU Compression Standard
- NVIDIA talks up RTX IO with GDeflate (used in DirectStorage 1.1) to speed up games
- Nvidia's nvCOMP now supports Zstd compression and decompression in GPU
-
DirectStorage 1.1 Coming Soon - GPU Decompression
NVIDIA nvcomp had GDeflate significantly earlier on the GPGPU side: https://github.com/NVIDIA/nvcomp. nvcomp releases before 2.3 were open-source.
-
How to defend when patent office gave smb monopoly for your work (e.g. found on github)? Defend JPEG XL from granted ANS patent? (author here)
In case of rANS patent, beside individual donations, also organizations blocked by given patent could donate - e.g. JPEG, Google, Nvidia, Facebook here.
-
Community Event: "nvCOMP: a CUDA library for Fast Lossless Compression and Decompression on GPUs"
Your link to https://github.com/NVIDIA/nvcomp, is broken because of the comma at the end.
isa-l
-
Intel QuickAssist Technology Zstandard Plugin for Zstandard
For using accelerators (QAT, I assume, because the article is about this) from the CLI, then QATzip[3] comes with a command line tool qatzip which can be used as described in the project ReadMe. I didn't test it, though, as I have no QAT-enabled device.
[1] https://github.com/intel/isa-l/tree/master/igzip
-
iHaveNoReasonToDoThisOtherThanBraggingRights
Ex 1: https://github.com/intel/isa-l/blob/master/README.md
- Pigz: Parallel gzip for modern multi-processor, multi-core machines
-
At least college isn't making me learn Objective-C.
Examples: - Someone I know created machine-optimized library in c and asm to accelerate compression, erasure coding, and encryption on Intel Xeon CPUs (https://github.com/intel/isa-l) which runs those ops WAY faster than the standard linux libraries. - My friend is making a retro SEGA genesis game using a C and asm dev kit (https://github.com/Stephane-D/SGDK)
-
How Much Faster Is Making a Tar Archive Without Gzip?
igzip (https://github.com/intel/isa-l) is much faster than gzip or pigz when it comes to decompression, 2-3x in my experience. There is also a Python module (isal) that provides a GzipFile-like wrapper class, for an easy speed-up of Python scripts that read gzipped files.
However, it only supports up to level 3 when compressing data, so it can't be used as a drop-in replacement for gzip. You also need to make sure to use the latest version if you are going to use it in the context of bioinformatics, since older versions choke on concatenated gzip files common in that field.
What are some alternatives?
dietgpu - GPU implementation of a fast generalized ANS (asymmetric numeral system) entropy encoder and decoder, with extensions for lossless compression of numerical and other data types in HPC/ML applications.
solaris-userland - Open Source software in Solaris using gmake based build system to drive building various software components.
rapidgzip - Gzip Decompression and Random Access for Modern Multi-Core Machines
pigz - A parallel implementation of gzip for modern multi-processor, multi-core machines.
DirectStorage - DirectStorage for Windows is an API that allows game developers to unlock the full potential of high speed NVMe drives for loading game assets.
TurboBench - Compression Benchmark
QATzip - Compression Library accelerated by IntelĀ® QuickAssist Technology
lib842