Regular incremental backups of millions of files?

This page summarizes the projects mentioned and recommended in the original post on /r/DataHoarder

Our great sponsors
  • WorkOS - The modern identity platform for B2B SaaS
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • SaaSHub - Software Alternatives and Reviews
  • sanoid

    These are policy-driven snapshot management and replication tools which use OpenZFS for underlying next-gen storage. (Btrfs support plans are shelved unless and until btrfs becomes reliable.)

  • Synoid (part of sanoid) is a nice wrapper around the zfs send/zfs recv commands that handle creation of snapshots, and setting the relevant options for you: https://github.com/jimsalterjrs/sanoid/blob/master/syncoid

  • Lsyncd

    Lsyncd (Live Syncing Daemon) synchronizes local directories with remote targets

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo
  • restic

    Fast, secure, efficient backup program

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts