Top 10 Python Rsync Projects

Back In Time

38 1,840 8.9 Python

Back In Time - An easy-to-use backup tool for GNU Linux using rsync in the back

Project mention: Opportunity for beginners: Some code cleaning in "Back In Time" | /r/opensource | 2023-12-07

it is often asked by beginners how and where starting to contribute. As member of the maintenance team of Back In Time (Backup software using rsync in the back, written with Python and Qt) I would like to introduce one of our "good first issues" (#1578).

Rdiff-backup

32 1,039 8.5 Python

Reverse differential backup tool, over a network or locally.

Project mention: Duplicity | news.ycombinator.com | 2024-01-24

For starters it has a tendency to paint itself into a corner on ENOSPC situations. You won't even be able to perform a restore if a backup was started but unfinished because it ran out of space. There's this process of "regressing" the repo [0] which must occur before you can do practically anything after an interrupted/failed backup. What this actually must do is undo the partial forward progress, by performing what's effectively a restore of the files that got pushed into the future relative to the rest of the repository, which requires more space. Unless you have/can create free space to do these things, it can become wedged... and if it's a dedicated backup system where you've intentionally filled disks up with restore points, you can find yourself having to throw out backups just to make things functional again - even ability to restore is affected.
That's the most obvious glaring problem, beyond that it's just kind of garbage in terms of the amount of space and time it requires to perform restores. Especially restores of files having many reverse-differential increments leading back to the desired restore point. It can require 2X the file's size in spare space to assemble the desired version, while it iteratively reconstructs all the intermediate versions in arriving at the desired version. Unless someone fixed this since I last had to deal with it, which is possible.
Source: Ages ago I worked for a startup[1] that shipped a backup appliance originally implemented by contractors using rdiff-backup. Writing a replacement that didn't suck but was compatible with rdiff-backup's repos consumed several years of my life...
There are far better options in 2024.
[0] https://github.com/rdiff-backup/rdiff-backup/blob/master/src...
[1] https://www.crunchbase.com/organization/axcient

InfluxDB

www.influxdata.com sponsored

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
skyplane

5 966 6.9 Python

🔥 Blazing fast bulk data transfers between any cloud 🔥

Project mention: Moving cloud storage | /r/seedboxes | 2023-05-19

msrsync

2 452 0.0 Python

Multi-stream rsync wrapper
rsyncy

1 116 5.3 Python

A status/progress bar for rsync
Butterfly-Backup

8 111 8.1 Python

Butterfly Backup is a simple command line wrapper of rsync for complex task, written in python.
sysrsync

2 110 5.6 Python

Simple and safe system's rsync wrapper for Python
WorkOS

workos.com sponsored

The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
PyFiSync

2 106 0.0 Python

Python (+ rsync or rclone) based intelligent file sync with automatic backups and file move/delete tracking.
rsyncer

1 11 10.0 Python

PyRsync is a simple rsync wrapper for python.
EnderChest

7 3 9.3 Python

syncing and linking for all your Minecraft instances

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).