Top 23 Python Backup Projects
-
Project mention: How does rsync deals with linux permissions if a backup is done from a linux filesystem partition to a ntfs partition? | reddit.com/r/linux4noobs | 2022-08-11
Consider using a proper backup tool such as BorgBackup that is capable of retaining permissions and extended attributes while also encrypting the backup even while storing it on a NTFS volume.
-
I have a cronjob that runs hourly which creates a tarball and then uses s3cmd to push files to Amazon S3. It also removes local backups that are older than 3 hours old, and retention policy removes S3 backups older than 7 days old.
-
SonarQube
Static code analysis for 29 languages.. Your projects are multi-language. So is SonarQube analysis. Find Bugs, Vulnerabilities, Security Hotspots, and Code Smells so you can release quality code every time. Get started analyzing your projects today for free.
-
-
Project mention: Recovering a PostgreSQL Database After a Hard Drive Failure | news.ycombinator.com | 2021-12-31
Hope this helps someone out there.
-
-
Project mention: I broke my system and I want to reinstall it but without losing /home | reddit.com/r/linux4noobs | 2022-08-12
If it's on another partition and you select that partition during installation, it should be OK. However, always make a backup of your Home folder/partition to an external drive. I recommend using Back In Time.
-
-
Scout APM
Less time debugging, more time building. Scout APM allows you to find and fix performance issues with no hassle. Now with error monitoring and external services monitoring, Scout is a developer's best friend when it comes to application development.
-
Project mention: What do you use to backup all your computers? | reddit.com/r/selfhosted | 2022-08-10
Same here. I also configure borg withborgmatic. Hetzner’s 1TB per 3.50€ is a bargain
-
This story starts with our own PgHoard, a PITR backup tool for PostgreSQL. PgHoard offers several methods to archive the WAL (Write Ahead Log), including pg_receivewal, a small application shipping with PostgreSQL which connects to a PostgreSQL cluster using the physical replication protocol to stream WAL as they are produced, optionally keeping track of the position on the server using a replication slot.
-
shallow-backup
-
Project mention: Does pushshift or any other archiver save any pictures or thumbnails from reddit posts? | reddit.com/r/pushshift | 2021-10-15
Like it depends on what they are using to scrape the subreddit the two I ran across yesterday ripme and Reddit Media Downloader both only run when called so it would be highly unlikely those would pick it up because they'd have to be called within the few seconds it was available.
-
Project mention: rsnapshot-like rotation backup tool to integrate in my scripts | reddit.com/r/selfhosted | 2022-07-31
I use rdiff-backup for a similar usecase. Maybe you find it also useful.
-
django-dbbackup
Management commands to help backup and restore your project database and media files
Project mention: Project for power companies - I might have bit more than I can chew | reddit.com/r/django | 2022-08-04And finally backups, this part is really important. When I was a beginner, I used to make silly mistakes which would lead me having to reset the entire database and rebuild. With backups you can simply restore back to a working point in time whenever something goes wrong. The django-dbbackup package can do this for you, however, you may run into a few issues which can be fixed. Or you could simply use PostgreSQL database dumps.
-
-
-
wikiteam
Tools for downloading and preserving wikis. We archive wikis, from Wikipedia to tiniest wikis. As of 2020, WikiTeam has preserved more than 250,000 wikis.
Project mention: Best way to archive a wiki "Powered by MediaWiki" | reddit.com/r/DataHoarder | 2022-04-15ArchiveTeam WikiTeam has download tooling: https://github.com/WikiTeam/wikiteam
-
Konsave is interesting too, I used it last year for some stuff. https://github.com/Prayag2/konsave
-
-
Project mention: Can I zip a folder of protonmail emails and move it to the drive? | reddit.com/r/ProtonMail | 2022-07-21
Check this out, you can use it with bridge https://github.com/rcarmo/imapbackup
-
DMArchiver
A tool to archive the direct messages, images and videos from your private conversations on Twitter
Apparently, there used to be sone nifty hacky program: https://github.com/Mincka/DMArchiver except twitter broke it.
-
Tasket/wyng-backup: Fast Time Machine-like backups for logical volumes\ (3 comments)
-
imapbox
Dump imap inbox to a local folder in a regular backupable format: html, json and attachements
Project mention: Self hosting web mail cloned from gmail/outlook.com | reddit.com/r/selfhosted | 2022-03-30This is more what I was thinking: https://github.com/polo2ro/imapbox
-
I've been a DataHoarder for a while, but only a modest ~10TB or so. I finally had the space to set up a rack and some servers, and am setting up a Ceph cluster with a ton of old disks I've accumulated over the years, totaling upwards of 20TB. I would like to still have an offsite and preferably offline backup for this data though, but backing up 20+ TB of data to a single drive is obviously off the table. Is there any other alternative to just deploying another Ceph cluster offsite? I don't want to use cloud storage due to the costs, and I also very much prefer to keep all my data under my own physical control. I was looking at Backy2 for the actual extraction of data and writing it to a destination, but that doesn't seem to support idempotent writes (i.e. take one full object and place it on a single drive). I could theoretically combine drives via LVM, but without additional redundancy (I would probably use raid 1 for that) losing one drive would be disastrous, and I am trying to avoid having to add additional redundancy for backups, considering the main ceph cluster will already have 3 copies of the data on it. I also am wondering if I should avoid using Ceph for the backups, since then all my eggs would be in the Ceph basket so to speak. I would love some advice from some of the folks with larger hoards and how you make backups. Thank you!
Python Backup related posts
- I broke my system and I want to reinstall it but without losing /home
- What do you use to backup all your computers?
- Is there software for automating swapping data between mostly full disks?
- Borgmatic – server/workstation backups powered by borg
- franken-kde-neon? :D
- Project for power companies - I might have bit more than I can chew
- Tried to Implement django-dbbackup, Failed Miserably
Index
What are some of the best open-source Backup projects in Python? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | BorgBackup | 8,507 |
| 2 | s3cmd | 3,939 |
| 3 | gmvault | 3,450 |
| 4 | wal-e | 3,341 |
| 5 | gphotos-sync | 1,466 |
| 6 | Back In Time | 1,424 |
| 7 | Barman | 1,363 |
| 8 | borgmatic | 1,187 |
| 9 | pghoard | 1,144 |
| 10 | shallow-backup | 937 |
| 11 | RedditDownloader | 844 |
| 12 | Rdiff-backup | 779 |
| 13 | django-dbbackup | 621 |
| 14 | grafana-backup-tool | 556 |
| 15 | roam-to-git | 543 |
| 16 | wikiteam | 515 |
| 17 | konsave | 374 |
| 18 | nfreezer | 292 |
| 19 | imapbackup | 234 |
| 20 | DMArchiver | 220 |
| 21 | wyng-backup | 194 |
| 22 | imapbox | 166 |
| 23 | backy2 | 165 |
Are you hiring? Post a new remote job listing for free.
