pixz
zfec
Our great sponsors
pixz | zfec | |
---|---|---|
8 | 2 | |
684 | 373 | |
- | 1.6% | |
4.8 | 7.7 | |
about 1 month ago | 6 months ago | |
C | Python | |
BSD 2-clause "Simplified" License | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
pixz
- pixz: Parallel, Indexed xz Compressor
-
Pigz: Parallel gzip for modern multi-processor, multi-core machines
That's really confusing since `pixz` exists and its "pixie" pronunciation actually works
https://github.com/vasi/pixz
-
Xz format considered inadequate for long-term archiving
pixz (https://github.com/vasi/pixz) is a nice parallel xz that additionally creates an index of tar files so you can decompress individual files. I wonder if dpkg could be extended to do something similar.
-
The best datahoarding hint that changed my live: use RAR archives (or any other archive format, really)
There's pixz, which indexes the tarball, allowing listing/extracting individual paths without decompressing the whole thing.
-
Hop: 25x faster than unzip and 10x faster than tar at reading individual files
Also relevant is pixz [1] which can do parallel LZMA/XZ decompression as well as tar file indexing.
[1] https://github.com/vasi/pixz
-
7-Zip 21.0 alpha introduces native Linux support
Yes, it's as easy as installing pixz with symlinks pointing to xz (I think Debian even does this automatically as part of its post-installation scripts).
-
C Deep
pixz - Parallel, indexed xz compressor. BSD-2-Clause
-
PeaZip 7.7.1 released!
Not quite what you're asking, but if you're a 7-Zip fan and on Linux, you might be interested in pixz.
zfec
-
The Haskell job market has been growing steaily since 2008
We used reflex-frp, so our app was a webview that worked on localhost and Android. The docs say it also works on iOS but we don't have an iPhone.
The process was learning Functional Reactive Programming, then learning reflex-frp, then getting a contract with obsidian (creators of reflex) for one hour a week where we could ask questions.
( https://github.com/reflex-frp/reflex-platform )
We had a grant requirement to create a phone client for Tahoe-LAFS, a Python application with a bunch of dependencies, including ZFEC, a forward error correction library.
( https://tahoe-lafs.readthedocs.io/ )
( https://github.com/tahoe-lafs/zfec/ )
We needed bug for bug compatibility with the Python codebase, so I ran Tahoe on localhost and tested the Haskell client against the Python server. We used servant to build the API, since it builds both client and server side from the same description.
( https://hackage.haskell.org/package/servant )
-
Xz format considered inadequate for long-term archiving
I disagree with the premise of the article. Archive formats are all inadequate for long-term resilience and making them adequate would be a violation of the “do one thing and do it right” principle.
To support resilience, you don’t need an alternative to xz, you need hashes and forward error correction. Specifically, compress your file using xz for high compression ratio, optionally encrypt it, then take a SHA-256 hash to be used for detecting errors, then generate parity files using PAR[1] or zfec[2] to correct errors.
[1] https://wiki.archlinux.org/title/Parchive
[2] https://github.com/tahoe-lafs/zfec
What are some alternatives?
p7zip - A new p7zip fork with additional codecs and improvements (forked from https://sourceforge.net/projects/sevenzip/ AND https://sourceforge.net/projects/p7zip/).
zpaqlpy - Compiles a zpaqlpy source file (a Python-subset) to a ZPAQ configuration file for usage with zpaqd
notepadqq - A simple, general-purpose editor for Linux
reflex-platform - A curated package set and set of tools that let you build Haskell packages so they can run on a variety of platforms. reflex-platform is built on top of the nix package manager.
asar - Simple extensive tar-like archive format with indexing
fossa-action - The action sets up and caches the latest release of fossa-cli, infer the correct configuration from the current system state, analyze the project for a list of its dependencies, and upload the results to FOSSA.
ratarmount - Access large archives as a filesystem efficiently, e.g., TAR, RAR, ZIP, GZ, BZ2, XZ, ZSTD archives
haskell-jobs-statistics
libarchive - Multi-format archive and compression library
precomp-cpp - Precomp, C++ version - further compress already compressed files
ansitest - ansible test stuff and root/bin bash scripts for Linux / OSX admins
solaris-userland - Open Source software in Solaris using gmake based build system to drive building various software components.