zfs_autobackup
httm
zfs_autobackup | httm | |
---|---|---|
20 | 98 | |
524 | 1,204 | |
- | - | |
7.5 | 9.9 | |
17 days ago | 3 days ago | |
Python | Rust | |
GNU General Public License v3.0 only | Mozilla Public License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
zfs_autobackup
-
Is It Good Practice to Back Up Data Sets Manually on Cold Storage Externals?
I recommend you to get familiar with https://github.com/psy0rz/zfs_autobackup/wiki first and then use the configuration you are happy with in my script.
- ZFS-autobackup – a lightweight but featureful ZFS replication solution
-
Backup Solution With Details About Deleted Files
I have a small home server running Ubuntu Server with a ZFS file system. To back up my files and use snapshots, I am currently using zfs-autobackup, which is easy to set up and works really well for ZFS. However, zfs-autobackup does not provide any information on files or folders that have been created, updated, or deleted from previous backups. While I am not too concerned about newly created or updated files, I would like to know which files have been deleted compared to the previous backup. Ideally, I would like to be able to see which files have been deleted before the backup takes place, so I can recover any unwanted deletions before it's too late.
-
Can't receive external ZFS dataset, can't get ZFS version info
as described here https://github.com/psy0rz/zfs_autobackup/issues/170
-
Move data to another pool?
Use ZFS Autobackup https://github.com/psy0rz/zfs_autobackup or ZFS send and receive to create a clone of an existing pool on a new system https://www.thegeekdiary.com/zfs-tutorials-creating-zfs-snapshot-and-clones/
-
Proxmox Backup Server Storage Analysis
I just went back to sanoid. I have also looked at zfs-autobackup and might give that a try. I've been combining sanoid/syncoid with this script to clean up snapshots
- zfs-check : A tool to verify your ZFS backups
- How can I zfs send an encrypted dataset tree to a pool in a way that will use this pool key?
-
Simple bash script for sending incremental snapshots daily
If you want it to work really well in all circumstances, it WILL get complex. I tried to keep the code as readable as i could though. There where many refactors. Check it out: https://github.com/psy0rz/zfs_autobackup
-
ZFS backups - Sanoid and Syncoid help
Also have a look at https://github.com/psy0rz/zfs_autobackup .
httm
-
Is my open-source project up to date with MIT license compliance and attribution?
My projects and many projects include a THIRD-PARTY-LICENSES.html file when I distribute binaries. See: https://github.com/kimono-koans/httm/blob/master/third_party/LICENSES_THIRD_PARTY.html
-
ZFS and Proxmox Questions
The only real advantage I can think of with nested ZFS is that the files in the KVM would obviously be individual inodes in the nested ZFS filesystem and datasets, in addition to the one inode per virtual volume on the hypervisor (or zvol). This would allow for granular file management on the kvm and the use of tools like https://github.com/kimono-koans/httm which is like a command line time machine for ZFS.
-
ZFS silent corruption bug found: replaces chunks inside copied files by zeroes
> It's worth noting that copy_file_range is used by a lot of things.
Yes, but the trigger feature, block cloning, only landed in the latest 2.2 release. If you immediately hopped on 2.2, and used a system with lots copy_file_range and FICLONE use, yes, you may have a problem (like, as you note, on Gentoo, where this problem surfaced).
Most people were just hopping on the bandwagon. My distro ships 2.1.5, so I have a 6 month wait until this feature lands, so I was just building copy_file_range support into my ZFS apps, right before news of this bug hit.[0]
> There are other things required to trigger the bug that are a lot less common though.
Exactly. My guess is the incidence of this will exceedingly rare for the common user/small NAS user/etc. I've run a corruption detector[0], and what I've found mostly indicates false positives. Some are build artifact fingerprints, which I don't care about, and which were deleted with the next build. The ones with an extant file on another system, I confirmed were a diff match with the origin using `rsync -rincv` and whats on snapshots with `httm --map-aliases`. So far no positive matches.
[0]: https://github.com/kimono-koans/httm
-
Are you running Linux with a filesystem capable of block cloning/FICLONE (ZFS >= 2.2, XFS, BTRFS)?
cargo install --git https://github.com/kimono-koans/httm --branch clones strace -f -o stderr.txt -e ioctl -- httm -r -R ~/.zshenv
- ZFS for Dummies
-
Workflow: Rolling forward with ZFS and `httm`
httm prints the size, date and corresponding locations of available unique versions (deduplicated by modify time and size) of files residing on snapshots, but can also be used interactively to select and restore files, even snapshot mounts by file! httm might change the way you use snapshots (because ZFS/BTRFS/NILFS2 aren't designed for finding for unique file versions) or the Time Machine concept (because httm is very fast!).
-
Really no easy GUI Btrfs snapshots for Fedora 38?
All btrfs snapshot tools can have different layouts. It's mostly a nightmare for any one tool to support. Although its not the tool you're looking for, FYI AFAIK httm supports all/most btrfs layouts, but it took more work than necessary to get there.
- Why there is no tool that shows how file is changed over time across snapshots?
-
Bcachefs – A New COW Filesystem
ZFS only option which requires super user privileges.
[0]: https://github.com/kimono-koans/httm/blob/master/httm.1
-
What's a really niche tool you use that you can't live without?
httm - Interactive, file-level Time Machine-like tool for ZFS/btrfs/nilfs2
What are some alternatives?
cockpit-zfs-manager - Cockpit ZFS Manager is an interactive ZFS on Linux admin package for Cockpit.
fzf-fish-integration - 🔍🐟 Fzf plugin for Fish
sanoid - These are policy-driven snapshot management and replication tools which use OpenZFS for underlying next-gen storage. (Btrfs support plans are shelved unless and until btrfs becomes reliable.)
dotfiles - My dotfiles
zrepl - One-stop ZFS backup & replication solution
zfsbootmenu - ZFS Bootloader for root-on-ZFS systems with support for snapshots and native full disk encryption
znapzend - zfs backup with remote capabilities and mbuffer integration.
zfs - OpenZFS on Linux and FreeBSD
zfs-auto-snapshot - ZFS Automatic Snapshot Service for Linux
reflex - Run a command when files change
zfs-replicate - A zfs send wrapper somewhat in the style of rsync
awesome-rust - A curated list of Rust code and resources.