Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →
Top 16 Python Backup Projects
-
ArchiveBox
🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...
-
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
Bup
Very efficient backup system based on the git packfile format, providing fast incremental saves and global deduplication (among and within files, including virtual machine images). Please post problems or patches to the mailing list for discussion (see the end of the README below).
-
-
-
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
-
zfs_autobackup
ZFS autobackup is used to periodicly backup ZFS filesystems to other locations. Easy to use and very reliable.
-
AWS-Automated-Daily-Instance-AMI-Snapshots
A serverless application to automatically backup instances and volumes regularly on AWS and delete them after a certain number of days
-
cartridge-backup
Script to make incremental backups onto multiple, smaller drives from one larger source
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
Project mention: Ask HN: What Underrated Open Source Project Deserves More Recognition? | news.ycombinator.com | 2024-03-07Two projects I greatly appreciate, allowing me to easily archive my bandcamp and GOG purchases (after the initial setup anyways):
https://github.com/easlice/bandcamp-downloader
https://github.com/Kalanyr/gogrepoc
And I recently learned about archivebox, which I think is going to be a fast favorite and finally let me clear out my mess of tabs/bookmarks: https://github.com/ArchiveBox/ArchiveBox
Project mention: Ask HN: Open-source Windows 11 backup solutions | news.ycombinator.com | 2024-04-04i use - and recommend - "borgbackup": for example with the "vorta" graphical frontend
* https://www.borgbackup.org/
* https://vorta.borgbase.com/install/windows/
just my 0.02€
Project mention: GitMounter: A FUSE filesystem for Git repositories | news.ycombinator.com | 2023-11-28The presented idea (one folder per commit, as FUSE fs) seems indeed largely impractical.
But there are good uses for mountable "git like" repos. For example for backup systems.
https://github.com/bup/bup
See the GitHub: https://github.com/wal-e/wal-e
Unmaintained would’ve made more sense to say, but the maintainer choose the words “obsolete” so I took those. :)
Seems to be obsolete due to a lack of interest and contributions.
Project mention: Opportunity for beginners: Some code cleaning in "Back In Time" | /r/opensource | 2023-12-07it is often asked by beginners how and where starting to contribute. As member of the maintenance team of Back In Time (Backup software using rsync in the back, written with Python and Qt) I would like to introduce one of our "good first issues" (#1578).
For starters it has a tendency to paint itself into a corner on ENOSPC situations. You won't even be able to perform a restore if a backup was started but unfinished because it ran out of space. There's this process of "regressing" the repo [0] which must occur before you can do practically anything after an interrupted/failed backup. What this actually must do is undo the partial forward progress, by performing what's effectively a restore of the files that got pushed into the future relative to the rest of the repository, which requires more space. Unless you have/can create free space to do these things, it can become wedged... and if it's a dedicated backup system where you've intentionally filled disks up with restore points, you can find yourself having to throw out backups just to make things functional again - even ability to restore is affected.
That's the most obvious glaring problem, beyond that it's just kind of garbage in terms of the amount of space and time it requires to perform restores. Especially restores of files having many reverse-differential increments leading back to the desired restore point. It can require 2X the file's size in spare space to assemble the desired version, while it iteratively reconstructs all the intermediate versions in arriving at the desired version. Unless someone fixed this since I last had to deal with it, which is possible.
Source: Ages ago I worked for a startup[1] that shipped a backup appliance originally implemented by contractors using rdiff-backup. Writing a replacement that didn't suck but was compatible with rdiff-backup's repos consumed several years of my life...
There are far better options in 2024.
[0] https://github.com/rdiff-backup/rdiff-backup/blob/master/src...
[1] https://www.crunchbase.com/organization/axcient
Project mention: Is It Good Practice to Back Up Data Sets Manually on Cold Storage Externals? | /r/truenas | 2023-12-10I recommend you to get familiar with https://github.com/psy0rz/zfs_autobackup/wiki first and then use the configuration you are happy with in my script.
Step 2: Install this open-source serverless stack which effectively runs daily, scans every region for any EBS and EC2 instances with that tag, and it creates a "rolling-window snapshot". It will by default run once a day and take snapshots, and it will keep 7 days worth of snapshots into the past. All those values are configurable.
Hello everyone, I wanted to share with you a project I've been working on called Backup Warden. I know many of you most likely already have a process in place to manage your backups, but if you're looking for a more advanced solution or if your backups are running wild with no retention policy in place, Backup Warden might be worth considering. Unlike some other tools, Backup Warden is capable of working with various storage options, including local, S3, and SSH. It also provides a plethora of options to meet different backup needs. If it doesn't have a specific feature you're looking for or doesn't work as expected, I encourage you to share your feedback. You can open a request or even create a pull request to contribute. Your input will help me improve the tool :) Thank you for your time, and please let me know if you have any questions.
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
Python Backups related posts
- I Backup
- Ask HN: For what purposes do you use a Raspberry Pi?
- Duplicity
- Is It Good Practice to Back Up Data Sets Manually on Cold Storage Externals?
- Opportunity for beginners: Some code cleaning in "Back In Time"
- What do you use for VPS backup? Would improved borg setup - pull mode - be enough? Or, do you use something else?
- GitMounter: A FUSE filesystem for Git repositories
-
A note from our sponsor - InfluxDB
www.influxdata.com | 26 Apr 2024
Index
What are some of the best open-source Backup projects in Python? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | ArchiveBox | 19,737 |
| 2 | BorgBackup | 10,526 |
| 3 | Bup | 7,075 |
| 4 | wal-e | 3,423 |
| 5 | Back In Time | 1,840 |
| 6 | Barman | 1,842 |
| 7 | Attic | 1,112 |
| 8 | Rdiff-backup | 1,038 |
| 9 | zfs_autobackup | 521 |
| 10 | hcloud-snapshot-as-backup | 82 |
| 11 | Duplicity | 50 |
| 12 | AWS-Automated-Daily-Instance-AMI-Snapshots | 43 |
| 13 | backup-warden | 13 |
| 14 | EnderChest | 3 |
| 15 | cartridge-backup | 2 |
| 16 | borgctl | 1 |
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com