Zip: How not to design a file format

• 7-Zip-zstd

  40 4,682 6.1 C

  7-Zip with support for Brotli, Fast-LZMA2, Lizard, LZ4, LZ5 and Zstandard

Do you consider rar a standard? It's a pretty good format, even though there aren't any good open-source implementations. But if you're willing to pay for your software, WinRAR command line versions are available for most platforms.

7zip is the most obvious free alternative. There is also a 7zip fork that offers zstd [1]. The command line experience for 7zip isn't very good however.

1: https://github.com/mcmilk/7-Zip-zstd

• tarindexer

  3 69 10.0 Python

  python module for indexing tar files for fast access

The bioinformatics community uses block based gzip compression (bgzip) [0]. The gzip standard allows for blocks so, using an additional index file, you can use it to seek to arbitrary locations and uncompress the block.

gzip compression is maybe not optimal now and the block segmentation reduces the efficiency even further.

Though not very standard, there is also a tar indexer program [1] that allows you to create an index on tar files to do the same.

My information is at least a couple years old so things may have changed.

[0] http://www.htslib.org/doc/bgzip.html

[1] https://github.com/devsnd/tarindexer

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project