ZFS for Dummies

This page summarizes the projects mentioned and recommended in the original post on news.ycombinator.com

Our great sponsors
  • WorkOS - The modern identity platform for B2B SaaS
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • SaaSHub - Software Alternatives and Reviews
  • sanoid

    These are policy-driven snapshot management and replication tools which use OpenZFS for underlying next-gen storage. (Btrfs support plans are shelved unless and until btrfs becomes reliable.)

  • I’m on the other end of the spectrum. I like knowing the flags and settings I use to create the pools.

    For snapshots and replication take a look at sanoid (https://github.com/jimsalterjrs/sanoid).

  • zfs-autosnap

    Minimal viable ZFS autosnapshot tool

  • A lot of these suggestions are heavily opinionated. Which is not necessarily bad, but they seem to mess with existing conventions just for the sake of it (why {pool}:{dataset}?).

    > Don't make me name [...] snapshots.

    You might like this little tool I wrote: https://github.com/rollcat/zfs-autosnap

    You put "zfs-autosnap snap" in cron hourly (or however often you want a snapshot), and "zfs-autosnap gc" in cron daily, and it takes care of maintaining a rolling history of snapshots, per the retention policy.

    It's not hard writing simple ZFS command wrappers, feel free to take my code and make your own tools.

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo
  • zfs

    OpenZFS on Linux and FreeBSD

  • Damn good question. I don’t have time to search for duplicates myself right now, but you can look through/ask the mailing list: https://zfsonlinux.topicbox.com/groups/zfs-discuss (looks weird, but this is a legit web front end for the mailing list) and the github issues: https://github.com/openzfs/zfs/issues

  • command-limits

    Build command lines that respect argument size limits

  • Nice, you reminded me of my own incomplete Rust rewrite of the Ruby ZFS snapshot script I wrote about a decade ago, and this bit of yak shaving that ended up derailing me: https://github.com/Freaky/command-limits

    I should pick them back up.

    (I snapshot in big chunks with xargs to try to minimise temporal smear - snapshots created in the same `zfs snapshot` command are atomic)

  • zfsnapr

    Recursive ZFS snapshot mounter

  • I make remote snapshot backups with Borg using this: https://github.com/Freaky/zfsnapr

    zfsnapr mounts recursive snapshots on a target directory so you can just point whatever backup tool you like at a normal directory tree.

    I still use send/recv for local backups - I think it's good to have a mix of strategies.

  • httm

    Interactive, file-level Time Machine-like tool for ZFS/btrfs/nilfs2 (and even actual Time Machine backups!)

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts