The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning. Learn more →
Top 23 Python Backup Projects
-
s3cmd
Official s3cmd repo -- Command line tool for managing S3 compatible storage services (including Amazon S3 and CloudFront).
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
django-dbbackup
Management commands to help backup and restore your project database and media files
-
konsave
A command line program written in Python to let you backup your dotfiles and switch to other ones in an instant. Works out-of-the box on KDE Plasma!
-
wikiteam
Tools for downloading and preserving wikis. We archive wikis, from Wikipedia to tiniest wikis. As of 2023, WikiTeam has preserved more than 350,000 wikis.
-
zfs_autobackup
ZFS autobackup is used to periodicly backup ZFS filesystems to other locations. Easy to use and very reliable.
-
little-backup-box
This software turns a single-board computer into a versatile, pocket-sized backup solution. Especially for digital photography, this is the solution for backing up images and media files on mass storage devices when traveling or at events. Media content can be viewed and rated for the subsequent process.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
Project mention: Ask HN: Open-source Windows 11 backup solutions | news.ycombinator.com | 2024-04-04i use - and recommend - "borgbackup": for example with the "vorta" graphical frontend
* https://www.borgbackup.org/
* https://vorta.borgbase.com/install/windows/
just my 0.02€
Project mention: Amazon S3 Tools: Command Line S3 Client and S3 Backup | news.ycombinator.com | 2024-01-26
Do you have other apps installed? Go into the package center and stop stuff. Your issue isn't corruption it's the old and not very powerful hardware (and possibly your drives) not being enough for the workload. If you want to try a different app there is a docker solution https://github.com/gaubert/gmvault
See the GitHub: https://github.com/wal-e/wal-e
Unmaintained would’ve made more sense to say, but the maintainer choose the words “obsolete” so I took those. :)
Seems to be obsolete due to a lack of interest and contributions.
Sadly, it’s not configurable. It’s just an inherent limitation of the API (1). Takeout is the best alternative, but for something more realtime you can use tools (2) that wrap the browser UI which also exports full quality.
(1) https://github.com/gilesknap/gphotos-sync#warning-google-api...
(2) https://github.com/JakeWharton/docker-gphotos-sync
Project mention: Opportunity for beginners: Some code cleaning in "Back In Time" | /r/opensource | 2023-12-07it is often asked by beginners how and where starting to contribute. As member of the maintenance team of Back In Time (Backup software using rsync in the back, written with Python and Qt) I would like to introduce one of our "good first issues" (#1578).
- for important files, a separate box where I have borgmatic [1] in deduplication mode installed; this is updated once in a while
Just curious: Do you have any reason to believe that such a data corruption bug is likely in ZFS? It seems like saying that ext4 could have a bug and you should also store stuff on NTFS, just in case (which I think does not make sense..).
[1]: https://github.com/borgmatic-collective/borgmatic
Is there a functioning tool to download the saved posts / upvotes that you do on reddit? This tool: https://github.com/shadowmoose/RedditDownloader was perfect, but it got rekt by the API changes and has been discontinued.
For starters it has a tendency to paint itself into a corner on ENOSPC situations. You won't even be able to perform a restore if a backup was started but unfinished because it ran out of space. There's this process of "regressing" the repo [0] which must occur before you can do practically anything after an interrupted/failed backup. What this actually must do is undo the partial forward progress, by performing what's effectively a restore of the files that got pushed into the future relative to the rest of the repository, which requires more space. Unless you have/can create free space to do these things, it can become wedged... and if it's a dedicated backup system where you've intentionally filled disks up with restore points, you can find yourself having to throw out backups just to make things functional again - even ability to restore is affected.
That's the most obvious glaring problem, beyond that it's just kind of garbage in terms of the amount of space and time it requires to perform restores. Especially restores of files having many reverse-differential increments leading back to the desired restore point. It can require 2X the file's size in spare space to assemble the desired version, while it iteratively reconstructs all the intermediate versions in arriving at the desired version. Unless someone fixed this since I last had to deal with it, which is possible.
Source: Ages ago I worked for a startup[1] that shipped a backup appliance originally implemented by contractors using rdiff-backup. Writing a replacement that didn't suck but was compatible with rdiff-backup's repos consumed several years of my life...
There are far better options in 2024.
[0] https://github.com/rdiff-backup/rdiff-backup/blob/master/src...
[1] https://www.crunchbase.com/organization/axcient
so I picked EOS, with KDE Plasma because I found something called Konsave and they said KDE Plasma is the most customized DE, so I'm sold.
Project mention: Be Gentle With Me -- I'm trying to export from the web version of Evernote. Can't find the "export" option? Help? | /r/Evernote | 2023-12-11There's a script which can download all your notes and then export them as ENEX - either individual notes or whole notebooks.
WikiTeam is working on the archival, with the usual XML dumps and image dumps. You can follow updates and see how to help:
https://github.com/WikiTeam/wikiteam/issues/465#issuecomment...
https://wiki.archiveteam.org/index.php/Miraheze
Already before the announcement we had XML dumps for thousands of Miraheze wikis.
Project mention: Is It Good Practice to Back Up Data Sets Manually on Cold Storage Externals? | /r/truenas | 2023-12-10I recommend you to get familiar with https://github.com/psy0rz/zfs_autobackup/wiki first and then use the configuration you are happy with in my script.
There is also a tool to port your save games from the xbox version to the steam version so I didnt loose any progress. https://github.com/Z1ni/XGP-save-extractor
Project mention: Moving SIGNAL from iPhone to Android: How to export all chats with media? | /r/signal | 2023-12-10question is in the title. I already found out that it is close to impossible to export all chats from iPhone to Android. Could it be possible via https://github.com/carderne/signal-export? Is there any other possibility (even third party app)?
Python Backup related posts
- Ask HN: QR Codes Unsuitable for Storing Gigabytes and Beyond in Graphic Format?
- I Backup
- Chkbit: Check the data integrity of your files over time
- Duplicity
- Be Gentle With Me -- I'm trying to export from the web version of Evernote. Can't find the "export" option? Help?
- Moving SIGNAL from iPhone to Android: How to export all chats with media?
- Opportunity for beginners: Some code cleaning in "Back In Time"
-
A note from our sponsor - WorkOS
workos.com | 25 Apr 2024
Index
What are some of the best open-source Backup projects in Python? This list will help you:
Project | Stars | |
---|---|---|
1 | BorgBackup | 10,526 |
2 | s3cmd | 4,418 |
3 | gmvault | 3,538 |
4 | wal-e | 3,423 |
5 | gphotos-sync | 1,919 |
6 | Back In Time | 1,840 |
7 | Barman | 1,842 |
8 | borgmatic | 1,639 |
9 | pghoard | 1,278 |
10 | shallow-backup | 1,180 |
11 | RedditDownloader | 1,100 |
12 | Rdiff-backup | 1,038 |
13 | django-dbbackup | 908 |
14 | konsave | 823 |
15 | grafana-backup-tool | 793 |
16 | evernote-backup | 779 |
17 | wikiteam | 686 |
18 | roam-to-git | 549 |
19 | zfs_autobackup | 521 |
20 | little-backup-box | 482 |
21 | XGP-save-extractor | 484 |
22 | signal-export | 413 |
23 | nfreezer | 304 |
Sponsored