sanoid
pyznap
Our great sponsors
sanoid | pyznap | |
---|---|---|
118 | 9 | |
2,872 | 198 | |
- | - | |
7.1 | 0.0 | |
8 days ago | about 1 month ago | |
Perl | Python | |
GNU General Public License v3.0 only | GNU General Public License v3.0 only |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
sanoid
- ZFS took full backup (send/receive) without snapshots but now what to prevent another full transfer?
-
ZFS for Dummies
I’m on the other end of the spectrum. I like knowing the flags and settings I use to create the pools.
For snapshots and replication take a look at sanoid (https://github.com/jimsalterjrs/sanoid).
-
Automatic container snapshots? cv4pve or zfs for a small homelab?
I use a combo of PBS and ZFS with Sanoid. The ZFS snapshots are nice because you define it all in a config file with frequent, hourly, daily, weekly, monthly snaps retained however you want. Importantly I use that on the root pool as well as my data pools. With PBS I have a custom retention config and have it backing up VMs and LXCs every couple hours. The PBS dedupe functionality makes it possible to keep full backups going back ages with minimal storage consumption, just the changed blocks. PBS is running inside a VM yes, but it’s storage is on another pool.
- [QUESTION] Dataset level replication
-
YSK: You can 'zfs send' over SSH to the cloud
[3] https://github.com/jimsalterjrs/sanoid/
-
New to ZFS, what layout to choose for 4x20TB drives?
No, it's written by the developer of Sanoid and Syncoid. The foremost open source ZFS snapshotting tool. He contributes on this sub all the time.
- Python Port of 600 Line Bash Script: rsync-time-machine.py for Rsync Backups
-
Some questions about the limitations of ZFS send.
Hi there! Not so much to answer your questions, but are you aware of Sanoid and syncoid? It does backup and remote Sync in the most seamless way. Perhaps this would solve some of your concerns...
- Help me understand zfs send for incremental send AND replication?
- Ask HN: Why isn't BTRFS the default FS in home-oriented Linux distributions?
pyznap
- Python Port of 600 Line Bash Script: rsync-time-machine.py for Rsync Backups
-
Should I be using zfs replicate, mirror, or something else entirely?
Sanoid/syncoids been mentioned but honestly for once a week learning by doing . Pyznap also excellent when you want to automate. https://github.com/yboetz/pyznap
-
Vdevs and snapshots?
In contrast, zfs snapshots are immutable, and thus anything short of a hardware failure can be addressed with a simple zfs rollback command. This includes deliberate, accidental, and malicious actions. They can also be automated (I personally use pyznap but syncoid is also quite popular), creating what is effectively an incremental backup. I maintain - for each dataset - 24 hourly, 7 daily, 6 monthly, and 1 yearly snapshot. Additionally, I have a wholly separate server that wakes up once a day to ingest these snapshots via zfs send/recv, so even if I made a horrible mistake or suffered a catastrophic hardware failure, I could completely restore from the other server. This last point brings snapshots firmly into the realm of backups, IMO.
-
Sanoid for snapshots management?
Another favorite option is Pyznap, which is python based and originally created to have have a few features and changes compared to sanoid. The author is also active here on reddit. I and not sure what the differences are anymore, it'll come down to trying them and preference.
- Advice on settings for spin-down (Ubuntu Server)
-
A small script to wake up a node that doesn't like to boot
I have two Supermicro X9 2Us, each with Proxmox. One has allegedly existed solely as a backup target, which wakes up daily to ingest ZFS snapshots using pyznap. Unfortunately, for reasons which are unclear, this particular node doesn't always like to see its boot device, which is an NVMe drive. It's the exact same board as my primary, with the exact same modified BIOS to allow booting from NVMe. It usually takes 2-3 cycles before it'll see it and boot.
-
Pros/cons of visible dataset for backups vs. only snapshots
I have two nearly identical systems, both running Proxmox, with Debian VMs. One is a backup, which (once this is worked out) will wake up daily to ingest incremental backups. I'm using pyznap to handle the backup strategy.
-
Ubuntu server 21.04 native encrypted root on zfs zfsbootmenu pyznap
https://github.com/yboetz/pyznap/issues/1#issuecomment-351015432
- Don't do VFIO to save money...or time (opinion piece)
What are some alternatives?
zrepl - One-stop ZFS backup & replication solution
zfsbackup-go - Backup ZFS snapshots to cloud storage such as Google, Amazon, Azure, etc. Built with the enterprise in mind.
zfs-auto-snapshot - ZFS Automatic Snapshot Service for Linux
cv4pve-autosnap - Automatic snapshot tool for Proxmox VE
znapzend - zfs backup with remote capabilities and mbuffer integration.
Vault - A tool for secrets management, encryption as a service, and privileged access management
zfs_autobackup - ZFS autobackup is used to periodicly backup ZFS filesystems to other locations. Easy to use and very reliable.
zfs - OpenZFS on Linux and FreeBSD
barrier - Open-source KVM software
UrBackup - UrBackup - Client/Server Open Source Network Backup for Windows, MacOS and Linux
zfsbootmenu - ZFS Bootloader for root-on-ZFS systems with support for snapshots and native full disk encryption