pigz
pixz
pigz | pixz | |
---|---|---|
9 | 8 | |
2,558 | 684 | |
- | - | |
3.0 | 4.8 | |
about 1 month ago | about 2 months ago | |
C | C | |
- | BSD 2-clause "Simplified" License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
pigz
-
Pigz: Parallel gzip for modern multi-processor, multi-core machines
You can grab the version from the solaris userland repo I linked and use it without me completing a homework assignment. Just grab the pigz-2.3.4 source then apply the patches from [1] in the proper order. Maybe some of them aren't needed for non-Solaris.
1. https://github.com/oracle/solaris-userland/tree/master/compo...
I thought I had opened a PR for that a long while ago, but it doesn't show up on github these days. In any case, I did ask Mark Adler to review it. It was never a priority, then the code changed in ways that I don't really want to deal with.
While looking through the PRs, I noticed a PR for Blocked GZip Format (BGZF) [2]. That's very interesting, and perhaps suggests that bgzip is a tool you would be interested in.
2. https://github.com/madler/pigz/pull/19
- ZSTD 1.5.5 is released with a corruption fix found at Google
- pigz: A parallel implementation of gzip for multi-core machines
-
Pigz: A parallel implementation of gzip for multi-core machines
The bit I found most interesting was actually:
https://github.com/madler/pigz/blob/master/try.h
https://github.com/madler/pigz/blob/master/try.c
which implements try/catch for C99.
-
Is there stronger zip compression than 7z a -mx9?
pigz seems to be able to do it. https://github.com/madler/pigz
pixz
- pixz: Parallel, Indexed xz Compressor
-
Pigz: Parallel gzip for modern multi-processor, multi-core machines
That's really confusing since `pixz` exists and its "pixie" pronunciation actually works
https://github.com/vasi/pixz
-
Xz format considered inadequate for long-term archiving
pixz (https://github.com/vasi/pixz) is a nice parallel xz that additionally creates an index of tar files so you can decompress individual files. I wonder if dpkg could be extended to do something similar.
-
The best datahoarding hint that changed my live: use RAR archives (or any other archive format, really)
There's pixz, which indexes the tarball, allowing listing/extracting individual paths without decompressing the whole thing.
-
Hop: 25x faster than unzip and 10x faster than tar at reading individual files
Also relevant is pixz [1] which can do parallel LZMA/XZ decompression as well as tar file indexing.
[1] https://github.com/vasi/pixz
-
7-Zip 21.0 alpha introduces native Linux support
Yes, it's as easy as installing pixz with symlinks pointing to xz (I think Debian even does this automatically as part of its post-installation scripts).
-
C Deep
pixz - Parallel, indexed xz compressor. BSD-2-Clause
-
PeaZip 7.7.1 released!
Not quite what you're asking, but if you're a 7-Zip fan and on Linux, you might be interested in pixz.
What are some alternatives?
rapidgzip - Gzip Decompression and Random Access for Modern Multi-Core Machines
p7zip - A new p7zip fork with additional codecs and improvements (forked from https://sourceforge.net/projects/sevenzip/ AND https://sourceforge.net/projects/p7zip/).
zstd
notepadqq - A simple, general-purpose editor for Linux
mpifileutils - File utilities designed for scalability and performance.
ratarmount - Access large archives as a filesystem efficiently, e.g., TAR, RAR, ZIP, GZ, BZ2, XZ, ZSTD archives
TurboBench - Compression Benchmark
asar - Simple extensive tar-like archive format with indexing
isa-l - Intelligent Storage Acceleration Library
libarchive - Multi-format archive and compression library
zstd - Zstandard - Fast real-time compression algorithm
precomp-cpp - Precomp, C++ version - further compress already compressed files