Python Backup

Open-source Python projects categorized as Backup Edit details

Top 23 Python Backup Projects

  • BorgBackup

    Deduplicating archiver with compression and authenticated encryption.

    Project mention: How does rsync deals with linux permissions if a backup is done from a linux filesystem partition to a ntfs partition? | reddit.com/r/linux4noobs | 2022-08-11

    Consider using a proper backup tool such as BorgBackup that is capable of retaining permissions and extended attributes while also encrypting the backup even while storing it on a NTFS volume.

  • s3cmd

    Official s3cmd repo -- Command line tool for managing Amazon S3 and CloudFront services

    Project mention: How does everyone backup their servers? | reddit.com/r/admincraft | 2021-10-26

    I have a cronjob that runs hourly which creates a tarball and then uses s3cmd to push files to Amazon S3. It also removes local backups that are older than 3 hours old, and retention policy removes S3 backups older than 7 days old.

  • SonarQube

    Static code analysis for 29 languages.. Your projects are multi-language. So is SonarQube analysis. Find Bugs, Vulnerabilities, Security Hotspots, and Code Smells so you can release quality code every time. Get started analyzing your projects today for free.

  • gmvault

    gmail backup software

    Project mention: GSuite Backup Solution with DS418? | reddit.com/r/synology | 2021-10-08
  • wal-e

    Continuous Archiving for Postgres

    Project mention: Recovering a PostgreSQL Database After a Hard Drive Failure | news.ycombinator.com | 2021-12-31

    Hope this helps someone out there.

    https://github.com/wal-e/wal-e

  • gphotos-sync

    Google Photos and Albums backup with Google Photos Library API

    Project mention: Backing up to hard drive, for good: tips? | reddit.com/r/googlephotos | 2022-05-27
  • Back In Time

    Back In Time - A simple backup tool for Linux

    Project mention: I broke my system and I want to reinstall it but without losing /home | reddit.com/r/linux4noobs | 2022-08-12

    If it's on another partition and you select that partition during installation, it should be OK. However, always make a backup of your Home folder/partition to an external drive. I recommend using Back In Time.

  • Barman

    Barman - Backup and Recovery Manager for PostgreSQL

  • Scout APM

    Less time debugging, more time building. Scout APM allows you to find and fix performance issues with no hassle. Now with error monitoring and external services monitoring, Scout is a developer's best friend when it comes to application development.

  • borgmatic

    Simple, configuration-driven backup software for servers and workstations

    Project mention: What do you use to backup all your computers? | reddit.com/r/selfhosted | 2022-08-10

    Same here. I also configure borg withborgmatic. Hetzner’s 1TB per 3.50€ is a bargain

  • pghoard

    PostgreSQL® backup and restore service

    Project mention: Future PostgreSQL: improvement to the replication protocol | dev.to | 2022-01-13

    This story starts with our own PgHoard, a PITR backup tool for PostgreSQL. PgHoard offers several methods to archive the WAL (Write Ahead Log), including pg_receivewal, a small application shipping with PostgreSQL which connects to a PostgreSQL cluster using the physical replication protocol to stream WAL as they are produced, optionally keeping track of the position on the server using a replication slot.

  • shallow-backup

    Git-integrated backup tool for macOS and Linux devs.

    Project mention: Is there a way to save system preferences? | reddit.com/r/MacOS | 2022-08-14

    shallow-backup

  • RedditDownloader

    Scrapes Reddit to download media of your choice.

    Project mention: Does pushshift or any other archiver save any pictures or thumbnails from reddit posts? | reddit.com/r/pushshift | 2021-10-15

    Like it depends on what they are using to scrape the subreddit the two I ran across yesterday ripme and Reddit Media Downloader both only run when called so it would be highly unlikely those would pick it up because they'd have to be called within the few seconds it was available.

  • Rdiff-backup

    Reverse differential backup tool, over a network or locally.

    Project mention: rsnapshot-like rotation backup tool to integrate in my scripts | reddit.com/r/selfhosted | 2022-07-31

    I use rdiff-backup for a similar usecase. Maybe you find it also useful.

  • django-dbbackup

    Management commands to help backup and restore your project database and media files

    Project mention: Project for power companies - I might have bit more than I can chew | reddit.com/r/django | 2022-08-04

    And finally backups, this part is really important. When I was a beginner, I used to make silly mistakes which would lead me having to reset the entire database and rebuild. With backups you can simply restore back to a working point in time whenever something goes wrong. The django-dbbackup package can do this for you, however, you may run into a few issues which can be fixed. Or you could simply use PostgreSQL database dumps.

  • grafana-backup-tool

    A Python-based application to backup Grafana settings using the Grafana API

  • roam-to-git

    Automatic RoamResearch backup to Git

  • wikiteam

    Tools for downloading and preserving wikis. We archive wikis, from Wikipedia to tiniest wikis. As of 2020, WikiTeam has preserved more than 250,000 wikis.

    Project mention: Best way to archive a wiki "Powered by MediaWiki" | reddit.com/r/DataHoarder | 2022-04-15

    ArchiveTeam WikiTeam has download tooling: https://github.com/WikiTeam/wikiteam

  • konsave

    Konsave lets use save your Linux customization and restore them very easily!

    Project mention: KDE config file locations? | reddit.com/r/kde | 2022-07-24

    Konsave is interesting too, I used it last year for some stuff. https://github.com/Prayag2/konsave

  • nfreezer

    nFreezer is an encrypted-at-rest backup tool.

    Project mention: Restic: Backups Done Right | news.ycombinator.com | 2021-11-13
  • imapbackup

    A Python script for incremental backups of IMAP mailboxes

    Project mention: Can I zip a folder of protonmail emails and move it to the drive? | reddit.com/r/ProtonMail | 2022-07-21

    Check this out, you can use it with bridge https://github.com/rcarmo/imapbackup

  • DMArchiver

    A tool to archive the direct messages, images and videos from your private conversations on Twitter

    Project mention: HOW THE F DO I EXPORT A DM CONVERSATION?? | reddit.com/r/Twitter | 2022-05-30

    Apparently, there used to be sone nifty hacky program: https://github.com/Mincka/DMArchiver except twitter broke it.

  • wyng-backup

    Fast Time Machine-like backups for logical volumes

    Project mention: Hacker News top posts: Sep 15, 2021 | reddit.com/r/hackerdigest | 2021-09-15

    Tasket/wyng-backup: Fast Time Machine-like backups for logical volumes\ (3 comments)

  • imapbox

    Dump imap inbox to a local folder in a regular backupable format: html, json and attachements

    Project mention: Self hosting web mail cloned from gmail/outlook.com | reddit.com/r/selfhosted | 2022-03-30

    This is more what I was thinking: https://github.com/polo2ro/imapbox

  • backy2

    backy2: Deduplicating block based backup software for ceph/rbd, image files and devices

    Project mention: Advice on backing up a Ceph cluster | reddit.com/r/DataHoarder | 2021-08-17

    I've been a DataHoarder for a while, but only a modest ~10TB or so. I finally had the space to set up a rack and some servers, and am setting up a Ceph cluster with a ton of old disks I've accumulated over the years, totaling upwards of 20TB. I would like to still have an offsite and preferably offline backup for this data though, but backing up 20+ TB of data to a single drive is obviously off the table. Is there any other alternative to just deploying another Ceph cluster offsite? I don't want to use cloud storage due to the costs, and I also very much prefer to keep all my data under my own physical control. I was looking at Backy2 for the actual extraction of data and writing it to a destination, but that doesn't seem to support idempotent writes (i.e. take one full object and place it on a single drive). I could theoretically combine drives via LVM, but without additional redundancy (I would probably use raid 1 for that) losing one drive would be disastrous, and I am trying to avoid having to add additional redundancy for backups, considering the main ceph cluster will already have 3 copies of the data on it. I also am wondering if I should avoid using Ceph for the backups, since then all my eggs would be in the Ceph basket so to speak. I would love some advice from some of the folks with larger hoards and how you make backups. Thank you!

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2022-08-14.

Python Backup related posts

Index

What are some of the best open-source Backup projects in Python? This list will help you:

Project Stars
1 BorgBackup 8,507
2 s3cmd 3,939
3 gmvault 3,450
4 wal-e 3,341
5 gphotos-sync 1,466
6 Back In Time 1,424
7 Barman 1,363
8 borgmatic 1,187
9 pghoard 1,144
10 shallow-backup 937
11 RedditDownloader 844
12 Rdiff-backup 779
13 django-dbbackup 621
14 grafana-backup-tool 556
15 roam-to-git 543
16 wikiteam 515
17 konsave 374
18 nfreezer 292
19 imapbackup 234
20 DMArchiver 220
21 wyng-backup 194
22 imapbox 166
23 backy2 165
Find remote jobs at our new job board 99remotejobs.com. There are 3 new remote jobs listed recently.
Are you hiring? Post a new remote job listing for free.
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com