Indexed_gzip Alternatives

Similar projects and alternatives to indexed_gzip

zstd

106 22,407 9.7 C indexed_gzip VS zstd

Zstandard - Fast real-time compression algorithm
brotli

26 13,123 8.1 TypeScript indexed_gzip VS brotli

Brotli compression format
InfluxDB

www.influxdata.com sponsored

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
rapidgzip

14 314 9.6 C++ indexed_gzip VS rapidgzip

Gzip Decompression and Random Access for Modern Multi-Core Machines
ratarmount

10 628 8.6 Python indexed_gzip VS ratarmount

Access large archives as a filesystem efficiently, e.g., TAR, RAR, ZIP, GZ, BZ2, XZ, ZSTD archives
tarindexer

3 69 10.0 Python indexed_gzip VS tarindexer

python module for indexing tar files for fast access
isa-l

5 904 8.6 C indexed_gzip VS isa-l

Intelligent Storage Acceleration Library
libslz

1 26 5.0 C indexed_gzip VS libslz

Stateless, zlib-compatible, and very fast compression library -- http://libslz.org
WorkOS

workos.com sponsored

The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
indexed_zstd

1 20 2.8 Python indexed_gzip VS indexed_zstd

A bridge for libzstd-seek to python. Based on mxmlnkn/indexed_bzip2

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better indexed_gzip alternative or higher similarity.

Suggest an alternative to indexed_gzip

indexed_gzip reviews and mentions

Posts with mentions or reviews of indexed_gzip. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2022-10-10.

How Much Faster Is Making a Tar Archive Without Gzip?
8 projects | news.ycombinator.com | 10 Oct 2022

Pragzip actually decompress in parallel and also access at random. I did a Show HN here: https://news.ycombinator.com/item?id=32366959
indexed_gzip https://github.com/pauldmccarthy/indexed_gzip can also do random access but is not parallel.
Both have to do a linear scan first though. The implementations however can do the linear scan on-demand, i.e., they scan only as far as needed.
bzip2 works very well with this approach. xz only works with this approach when compressed with multiple blocks. Similar is true for zstd.
For zstd, there also exists a seekable variant, which stores the block index at the end as metadata to avoid the linear scan. indexed_zstd offers random access to those files https://github.com/martinellimarco/indexed_zstd
I wrote pragzip and also combined all of the other random access compression backends in ratarmount to offer random access to TAR files that is magnitudes faster than archivemount: https://github.com/mxmlnkn/ratarmount
Is there any windows archival software (free or paid) that can browse tar.gz files without extracting the whole tarball?
2 projects | /r/DataHoarder | 10 Dec 2021

The pieces are there. https://github.com/devsnd/tarindexer/blob/master/tarindexer.py is a prototype of indexing and seeking a tar file in python. https://github.com/pauldmccarthy/indexed_gzip allows indexing and seeking a gzip file. If those pieces of code were combined it could give you efficient targeted file extraction, but you'd need to find a coder with enough time and motivation to fuss with it.