The various scripts I use to back up my home computers using SSH and rsync

• backup-scripts

  6 197 10.0 Clojure

  The various scripts I use to back up my home computers using ssh and rsync (by eamonnsullivan)

• s3-backup

  1 2 10.0 C

  Incremental file system backup to S3 / FUSE mount

I've got a solution that I've used to back up machines for my group, but never did the last 10% to make it something plug-and-play for other folks: https://github.com/pjd-nu/s3-backup

Full and incremental backups of a directory tree to S3 objects, one per backup, and access to existing backups via FUSE mount. With a bit more scripting (mostly automount) and maybe shifting some cached data from RAM to the local file system it should be fairly comparable to Apple Time Machine - not designed to restore your disk as much as to be able to access its contents at different points in time.

If you're interested in it, feel free to drop me a note - my email is in my Github profile I think.

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• btrbk

  79 1,528 6.7 Perl

  Tool for creating snapshots and remote backups of btrfs subvolumes

For anyone using btrfs on their system, I heartily recommend btrbk, which has served me very well for making incremental backups with a customizable retention period: https://github.com/digint/btrbk

• Rsnapshot

  72 3,080 5.1 Perl

  a tool for backing up your data using rsync (if you want to get help, use https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss)

  

His backup rotation algorithm is very close to what rsnapshot does.

https://rsnapshot.org/

• restic

  357 23,766 9.7 Go

  Fast, secure, efficient backup program

  

Python programmer here, but I actually prefer Restic [0]. While more or less the same experience, the huge selling point to me is that the backup program is a single executable that can be easily stored alongside the backups. I do not want any dependency/environment issues to assert themselves when restoration is required (which is most likely on a virgin, unconfigured system).

[0] https://restic.net/

• rclone

  963 43,840 9.8 Go

  "rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Azure Blob, Azure Files, Yandex Files

  

• kopia

  224 6,270 9.6 Go

  Cross-platform backup tool for Windows, macOS & Linux with fast, incremental backups, client-side end-to-end encryption, compression and data deduplication. CLI and GUI included.

  

You can also take a look at Kopia (https://kopia.io/).

I've been using Borg, Restic and Kopia for a long time and Kopia is my personal favorite - very fast, very efficient, runs in the background automatically without having to schedule a CRON or anything like that.

Only downside is that the backups are made of a HUGE number of files, so when synchronizing it can sometimes take a bit of time to check the ~5k files.

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• unison

  27 3,726 8.5 OCaml

  Unison file synchronizer (by bcpierce00)

• Bup

  20 7,075 8.0 Python

  Very efficient backup system based on the git packfile format, providing fast incremental saves and global deduplication (among and within files, including virtual machine images). Please post problems or patches to the mailing list for discussion (see the end of the README below).

  

You may really like https://github.com/bup/bup if you want something a bit more modern but in the same style

• hrsync

  1 62 10.0 Shell

  rsync backup with a bit of magic, decting moved and renamed files

--link-dest is also used in hrsync, another rsync wrapper: https://github.com/dparoli/hrsync/blob/master/hrsync#L52

Suggest a related project