Container for archiving many small files

This page summarizes the projects mentioned and recommended in the original post on reddit.com/r/DataHoarder

Our great sponsors
  • SonarLint - Clean code begins in your IDE with SonarLint
  • Scout APM - Less time debugging, more time building
  • SaaSHub - Software Alternatives and Reviews
  • FileFlows

    FileFlows is a file processing application that can execute actions against a file in a tree flow structure.

    I think FileFlows might be what your after. The dev is very very responsive on discord and may be able to develop a specific plugin for you (via a small patreon donation) to support your requirement. It already supports renaming, moving, zipping, file size comparison etc and many other file commands. https://fileflows.com

  • archivemount

    A fuse filesystem for mounting archives in formats supported by libarchive.

    For bundling, my main constraint is that archivemount or gio mount archive:// can seek within the archive: so tar and zip are fine, but tar.gz is not. Squashfs also works well.

  • SonarLint

    Clean code begins in your IDE with SonarLint. Up your coding game and discover issues early. SonarLint is a free plugin that helps you find & fix bugs and security issues from the moment you start writing code. Install from your favorite IDE marketplace today.

  • BorgBackup

    Deduplicating archiver with compression and authenticated encryption.

    If you bundle by date-added, incremental backup stays very simple, as most files never change. If you have to bundle some other way such that all the files are always changing a little bit, some backup tools handle this well and others do not. Dar is a notably unique backup tool that can do differential/incremental binary delta backups and still have the interface "backup data is written to a plain ol' file" rather than some more complicated bidirectional communication protocol like Borg. This lets you layer on other it's-just-a-file technologies like generating .par2 files for your backups, encryption, asymmetric encryption, and simple remote transfer & storage.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts