nvcomp
pigz
| nvcomp | pigz | |
|---|---|---|
| 7 | 9 | |
| 528 | 2,550 | |
| 1.7% | - | |
| 4.8 | 3.0 | |
| 7 months ago | about 1 month ago | |
| C++ | C | |
| GNU General Public License v3.0 or later | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
nvcomp
- Pigz: Parallel gzip for modern multi-processor, multi-core machines
- GDeflate: An Open GPU Compression Standard
- NVIDIA talks up RTX IO with GDeflate (used in DirectStorage 1.1) to speed up games
- Nvidia's nvCOMP now supports Zstd compression and decompression in GPU
-
DirectStorage 1.1 Coming Soon - GPU Decompression
NVIDIA nvcomp had GDeflate significantly earlier on the GPGPU side: https://github.com/NVIDIA/nvcomp. nvcomp releases before 2.3 were open-source.
-
How to defend when patent office gave smb monopoly for your work (e.g. found on github)? Defend JPEG XL from granted ANS patent? (author here)
In case of rANS patent, beside individual donations, also organizations blocked by given patent could donate - e.g. JPEG, Google, Nvidia, Facebook here.
-
Community Event: "nvCOMP: a CUDA library for Fast Lossless Compression and Decompression on GPUs"
Your link to https://github.com/NVIDIA/nvcomp, is broken because of the comma at the end.
pigz
-
Pigz: Parallel gzip for modern multi-processor, multi-core machines
You can grab the version from the solaris userland repo I linked and use it without me completing a homework assignment. Just grab the pigz-2.3.4 source then apply the patches from [1] in the proper order. Maybe some of them aren't needed for non-Solaris.
1. https://github.com/oracle/solaris-userland/tree/master/compo...
I thought I had opened a PR for that a long while ago, but it doesn't show up on github these days. In any case, I did ask Mark Adler to review it. It was never a priority, then the code changed in ways that I don't really want to deal with.
While looking through the PRs, I noticed a PR for Blocked GZip Format (BGZF) [2]. That's very interesting, and perhaps suggests that bgzip is a tool you would be interested in.
2. https://github.com/madler/pigz/pull/19
- ZSTD 1.5.5 is released with a corruption fix found at Google
- pigz: A parallel implementation of gzip for multi-core machines
-
Pigz: A parallel implementation of gzip for multi-core machines
The bit I found most interesting was actually:
https://github.com/madler/pigz/blob/master/try.h
https://github.com/madler/pigz/blob/master/try.c
which implements try/catch for C99.
-
Is there stronger zip compression than 7z a -mx9?
pigz seems to be able to do it. https://github.com/madler/pigz
What are some alternatives?
dietgpu - GPU implementation of a fast generalized ANS (asymmetric numeral system) entropy encoder and decoder, with extensions for lossless compression of numerical and other data types in HPC/ML applications.
rapidgzip - Gzip Decompression and Random Access for Modern Multi-Core Machines
zstd
DirectStorage - DirectStorage for Windows is an API that allows game developers to unlock the full potential of high speed NVMe drives for loading game assets.
mpifileutils - File utilities designed for scalability and performance.
TurboBench - Compression Benchmark
isa-l - Intelligent Storage Acceleration Library
solaris-userland - Open Source software in Solaris using gmake based build system to drive building various software components.
zstd - Zstandard - Fast real-time compression algorithm