Zip: How not to design a file format

This page summarizes the projects mentioned and recommended in the original post on news.ycombinator.com

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured
  • 7-Zip-zstd

    7-Zip with support for Brotli, Fast-LZMA2, Lizard, LZ4, LZ5 and Zstandard

  • Do you consider rar a standard? It's a pretty good format, even though there aren't any good open-source implementations. But if you're willing to pay for your software, WinRAR command line versions are available for most platforms.

    7zip is the most obvious free alternative. There is also a 7zip fork that offers zstd [1]. The command line experience for 7zip isn't very good however.

    1: https://github.com/mcmilk/7-Zip-zstd

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • tarindexer

    python module for indexing tar files for fast access

  • The bioinformatics community uses block based gzip compression (bgzip) [0]. The gzip standard allows for blocks so, using an additional index file, you can use it to seek to arbitrary locations and uncompress the block.

    gzip compression is maybe not optimal now and the block segmentation reduces the efficiency even further.

    Though not very standard, there is also a tar indexer program [1] that allows you to create an index on tar files to do the same.

    My information is at least a couple years old so things may have changed.

    [0] http://www.htslib.org/doc/bgzip.html

    [1] https://github.com/devsnd/tarindexer

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • How can I fix this

    1 project | /r/androidroot | 25 May 2023
  • Tried using forked 7-zip sfx

    1 project | /r/PeaZip | 3 Mar 2023
  • Please read carefully. When I download a zip file and click to extract, in every other OS man created, the files would automatically extract HERE. Now everytime I click extract, I have to navigate through this prompt. How do I REMOVE this such that the extract method is always set to HERE?

    1 project | /r/WindowsHelp | 19 Feb 2023
  • Forspoken running on RX480 on Ubuntu , most of the time it's above 30FPS. It's pretty playable so AMD should release a fix for Polaris cards to make it playable on Windows.

    3 projects | /r/Amd | 27 Jan 2023
  • Thanks WinRAR… and no thanks

    1 project | /r/pcmasterrace | 10 Jan 2023