pigz
nvcomp
| pigz | nvcomp | |
|---|---|---|
| 9 | 7 | |
| 2,558 | 528 | |
| - | 1.7% | |
| 3.0 | 4.8 | |
| about 1 month ago | 7 months ago | |
| C | C++ | |
| - | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
pigz
-
Pigz: Parallel gzip for modern multi-processor, multi-core machines
You can grab the version from the solaris userland repo I linked and use it without me completing a homework assignment. Just grab the pigz-2.3.4 source then apply the patches from [1] in the proper order. Maybe some of them aren't needed for non-Solaris.
1. https://github.com/oracle/solaris-userland/tree/master/compo...
I thought I had opened a PR for that a long while ago, but it doesn't show up on github these days. In any case, I did ask Mark Adler to review it. It was never a priority, then the code changed in ways that I don't really want to deal with.
While looking through the PRs, I noticed a PR for Blocked GZip Format (BGZF) [2]. That's very interesting, and perhaps suggests that bgzip is a tool you would be interested in.
2. https://github.com/madler/pigz/pull/19
- ZSTD 1.5.5 is released with a corruption fix found at Google
- pigz: A parallel implementation of gzip for multi-core machines
-
Pigz: A parallel implementation of gzip for multi-core machines
The bit I found most interesting was actually:
https://github.com/madler/pigz/blob/master/try.h
https://github.com/madler/pigz/blob/master/try.c
which implements try/catch for C99.
-
Is there stronger zip compression than 7z a -mx9?
pigz seems to be able to do it. https://github.com/madler/pigz
nvcomp
- Pigz: Parallel gzip for modern multi-processor, multi-core machines
- GDeflate: An Open GPU Compression Standard
- NVIDIA talks up RTX IO with GDeflate (used in DirectStorage 1.1) to speed up games
- Nvidia's nvCOMP now supports Zstd compression and decompression in GPU
-
DirectStorage 1.1 Coming Soon - GPU Decompression
NVIDIA nvcomp had GDeflate significantly earlier on the GPGPU side: https://github.com/NVIDIA/nvcomp. nvcomp releases before 2.3 were open-source.
-
How to defend when patent office gave smb monopoly for your work (e.g. found on github)? Defend JPEG XL from granted ANS patent? (author here)
In case of rANS patent, beside individual donations, also organizations blocked by given patent could donate - e.g. JPEG, Google, Nvidia, Facebook here.
-
Community Event: "nvCOMP: a CUDA library for Fast Lossless Compression and Decompression on GPUs"
Your link to https://github.com/NVIDIA/nvcomp, is broken because of the comma at the end.
What are some alternatives?
rapidgzip - Gzip Decompression and Random Access for Modern Multi-Core Machines
dietgpu - GPU implementation of a fast generalized ANS (asymmetric numeral system) entropy encoder and decoder, with extensions for lossless compression of numerical and other data types in HPC/ML applications.
zstd
mpifileutils - File utilities designed for scalability and performance.
DirectStorage - DirectStorage for Windows is an API that allows game developers to unlock the full potential of high speed NVMe drives for loading game assets.
TurboBench - Compression Benchmark
isa-l - Intelligent Storage Acceleration Library
zstd - Zstandard - Fast real-time compression algorithm
solaris-userland - Open Source software in Solaris using gmake based build system to drive building various software components.