zpaqlpy
pixz
zpaqlpy | pixz | |
---|---|---|
2 | 8 | |
19 | 684 | |
- | - | |
10.0 | 4.8 | |
over 1 year ago | about 2 months ago | |
Rust | C | |
GNU General Public License v3.0 only | BSD 2-clause "Simplified" License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
zpaqlpy
-
Xz format considered inadequate for long-term archiving
ZPAQ is the name of the tool but ZPAQ is also the name of the container format that gets used. ZPAQ embeds the decompression algorithm in the archive. One could store zstd-compressed blocks in ZPAQ archives as soon as a zpaql decompressor exists (e.g., for brotli there is a slow one implemented in a python subset and compiled to zpaql https://github.com/pothos/zpaqlpy).
I don't know exactly whether other formats are better for seeking and streaming, but since the baseline is tar, ZPAQ (in the 2.0 spec) is already better as it supports deduplication and files can even be updated append-only, and the compression is not an afterthought wrapped around it but well integrated.
- QOI – The Quite OK Image Format
pixz
- pixz: Parallel, Indexed xz Compressor
-
Pigz: Parallel gzip for modern multi-processor, multi-core machines
That's really confusing since `pixz` exists and its "pixie" pronunciation actually works
https://github.com/vasi/pixz
-
Xz format considered inadequate for long-term archiving
pixz (https://github.com/vasi/pixz) is a nice parallel xz that additionally creates an index of tar files so you can decompress individual files. I wonder if dpkg could be extended to do something similar.
-
The best datahoarding hint that changed my live: use RAR archives (or any other archive format, really)
There's pixz, which indexes the tarball, allowing listing/extracting individual paths without decompressing the whole thing.
-
Hop: 25x faster than unzip and 10x faster than tar at reading individual files
Also relevant is pixz [1] which can do parallel LZMA/XZ decompression as well as tar file indexing.
[1] https://github.com/vasi/pixz
-
7-Zip 21.0 alpha introduces native Linux support
Yes, it's as easy as installing pixz with symlinks pointing to xz (I think Debian even does this automatically as part of its post-installation scripts).
-
C Deep
pixz - Parallel, indexed xz compressor. BSD-2-Clause
-
PeaZip 7.7.1 released!
Not quite what you're asking, but if you're a 7-Zip fan and on Linux, you might be interested in pixz.
What are some alternatives?
zfec - zfec -- an efficient, portable erasure coding tool
p7zip - A new p7zip fork with additional codecs and improvements (forked from https://sourceforge.net/projects/sevenzip/ AND https://sourceforge.net/projects/p7zip/).
zstd - Zstandard - Fast real-time compression algorithm
notepadqq - A simple, general-purpose editor for Linux
BorgBackup - Deduplicating archiver with compression and authenticated encryption.
ratarmount - Access large archives as a filesystem efficiently, e.g., TAR, RAR, ZIP, GZ, BZ2, XZ, ZSTD archives
restic - Fast, secure, efficient backup program
asar - Simple extensive tar-like archive format with indexing
fpng - Super fast C++ .PNG writer/reader
libarchive - Multi-format archive and compression library
fpnge - Demo of a fast PNG encoder.
precomp-cpp - Precomp, C++ version - further compress already compressed files