structured-text-tools VS btrbk

This works well in scripts and logs of all the commands you need to do to reproduce the current state of the system from a scratch install. Also can be used with diff -u and patch, sed, perl, and awk oneliners and structured text tools. You can also capture most of the commands using sudo logging feature but it won't capture the here documents. But for modest size files you can use newlines in echo commands. Note that commands which use redrection should use something like ~~~~ sudo bash -c "echo 'foo' >>file.txt" ~~~~ instead of "sudo echo foo >>file.txt" or "echo foo | sudo tee -a file.txt

TFA is about how to handle csv files with awk. This might be useful in straightforward cases.

For all others I’d recommend to have a look at

https://github.com/dbohdan/structured-text-tools

which lists tools to handle structure text formats

in general, I'd pick something from https://github.com/dbohdan/structured-text-tools

Also, here is a list of structured text tools. You may find some tools there that are helpful in editing configuration files from the command line. Or you can use "diff -u" to create a patch file (you need to save the patch files along with sudo.log) to recreate. Also, use sfdisk --dump and sfdisk --backup to save partition information in a form that can be used to recreate backups.

That's still easier using snapshots and something like btrbk. Snapshot the directory at start, prune if there are too many snapshots (or snapshots get too old).

I'm on Arch, but you might still find it useful: Btrfs snapshots Arch Wiki - Incremental backup to external drive GitHub - btrbk

the smoothest backup tool i have seen for Linux is btrbk works real nice and is customizable for almost all use-cases BTRFS rocks :)

I recommend redundancy and regular verification is you want to insure your data against corruption. If you do that, you can forget about things like ECC. My setup is a NUC server running Ubuntu with a USB3-connected storage drive running BTRFS. I use btrbk to auto-snapshot and auto-replicate via incremental sends to my BTRFS backup drive, and RotKraken to track integrity of the data with a monthly verification run so that I notice corruption in time to correct it.

In pondering my backup strategy, I was wondering if I could use BTRFS snapshots and a backup tool like btrbk, which is a nice integrated snapshot/backup solution I've used happily on desktop Linux. BTRFS needs subvolumes for snapshots, so I couldn't backup the host itself (which wasn't installed with a / subvolume like other distributions I've used), but it could snapshot the VMs and containers, which have their own individual subvolumes. Then btrbk can send that snapshot in an incremental fashion to external storage.

I then installed btrbk and tried to follow the instructions to create snapshots of root and home on the SSD and then send/receive those to the HDD. I mainly used https://github.com/digint/btrbk and https://mutschler.dev/linux/fedora-btrfs-35/, but I don't use luks.

For anyone using btrfs on their system, I heartily recommend btrbk, which has served me very well for making incremental backups with a customizable retention period: https://github.com/digint/btrbk

btrbk is the best solution I know.

I use BTRBK to make and copy the BTRFS snapshots to my HDD. I schedule it to run every 3 hours using a Sytemd unit file through my own script to avoid running the backup at inconvenient moments: