Python Backups

Open-source Python projects categorized as Backups

Top 16 Python Backup Projects

  • ArchiveBox

    🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...

  • Project mention: Ask HN: What Underrated Open Source Project Deserves More Recognition? | news.ycombinator.com | 2024-03-07

    Two projects I greatly appreciate, allowing me to easily archive my bandcamp and GOG purchases (after the initial setup anyways):

    https://github.com/easlice/bandcamp-downloader

    https://github.com/Kalanyr/gogrepoc

    And I recently learned about archivebox, which I think is going to be a fast favorite and finally let me clear out my mess of tabs/bookmarks: https://github.com/ArchiveBox/ArchiveBox

  • BorgBackup

    Deduplicating archiver with compression and authenticated encryption.

  • Project mention: Ask HN: Open-source Windows 11 backup solutions | news.ycombinator.com | 2024-04-04

    i use - and recommend - "borgbackup": for example with the "vorta" graphical frontend

    * https://www.borgbackup.org/

    * https://vorta.borgbase.com/install/windows/

    just my 0.02€

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • Bup

    Very efficient backup system based on the git packfile format, providing fast incremental saves and global deduplication (among and within files, including virtual machine images). Please post problems or patches to the mailing list for discussion (see the end of the README below).

  • Project mention: GitMounter: A FUSE filesystem for Git repositories | news.ycombinator.com | 2023-11-28

    The presented idea (one folder per commit, as FUSE fs) seems indeed largely impractical.

    But there are good uses for mountable "git like" repos. For example for backup systems.

    https://github.com/bup/bup

  • wal-e

    Continuous Archiving for Postgres

  • Project mention: Run PostgreSQL. The Kubernetes Way | news.ycombinator.com | 2023-09-22

    See the GitHub: https://github.com/wal-e/wal-e

    Unmaintained would’ve made more sense to say, but the maintainer choose the words “obsolete” so I took those. :)

    Seems to be obsolete due to a lack of interest and contributions.

  • Back In Time

    Back In Time - An easy-to-use backup tool for GNU Linux using rsync in the back

  • Project mention: Opportunity for beginners: Some code cleaning in "Back In Time" | /r/opensource | 2023-12-07

    it is often asked by beginners how and where starting to contribute. As member of the maintenance team of Back In Time (Backup software using rsync in the back, written with Python and Qt) I would like to introduce one of our "good first issues" (#1578).

  • Barman

    Barman - Backup and Recovery Manager for PostgreSQL

  • Attic

    Deduplicating backup program

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo
  • Rdiff-backup

    Reverse differential backup tool, over a network or locally.

  • Project mention: Duplicity | news.ycombinator.com | 2024-01-24

    For starters it has a tendency to paint itself into a corner on ENOSPC situations. You won't even be able to perform a restore if a backup was started but unfinished because it ran out of space. There's this process of "regressing" the repo [0] which must occur before you can do practically anything after an interrupted/failed backup. What this actually must do is undo the partial forward progress, by performing what's effectively a restore of the files that got pushed into the future relative to the rest of the repository, which requires more space. Unless you have/can create free space to do these things, it can become wedged... and if it's a dedicated backup system where you've intentionally filled disks up with restore points, you can find yourself having to throw out backups just to make things functional again - even ability to restore is affected.

    That's the most obvious glaring problem, beyond that it's just kind of garbage in terms of the amount of space and time it requires to perform restores. Especially restores of files having many reverse-differential increments leading back to the desired restore point. It can require 2X the file's size in spare space to assemble the desired version, while it iteratively reconstructs all the intermediate versions in arriving at the desired version. Unless someone fixed this since I last had to deal with it, which is possible.

    Source: Ages ago I worked for a startup[1] that shipped a backup appliance originally implemented by contractors using rdiff-backup. Writing a replacement that didn't suck but was compatible with rdiff-backup's repos consumed several years of my life...

    There are far better options in 2024.

    [0] https://github.com/rdiff-backup/rdiff-backup/blob/master/src...

    [1] https://www.crunchbase.com/organization/axcient

  • zfs_autobackup

    ZFS autobackup is used to periodicly backup ZFS filesystems to other locations. Easy to use and very reliable.

  • Project mention: Is It Good Practice to Back Up Data Sets Manually on Cold Storage Externals? | /r/truenas | 2023-12-10

    I recommend you to get familiar with https://github.com/psy0rz/zfs_autobackup/wiki first and then use the configuration you are happy with in my script.

  • hcloud-snapshot-as-backup

    Hetzner Cloud - Automatic Snapshots as Backups for more flexibility

  • Duplicity

    Unnoficial fork of Duplicity - Bandwidth Efficient Encrypted Backup (by hcarvalhoalves)

  • AWS-Automated-Daily-Instance-AMI-Snapshots

    A serverless application to automatically backup instances and volumes regularly on AWS and delete them after a certain number of days

  • Project mention: Enabling Automated Snapshots with AWS EBS CSI? | /r/kubernetes | 2023-05-23

    Step 2: Install this open-source serverless stack which effectively runs daily, scans every region for any EBS and EC2 instances with that tag, and it creates a "rolling-window snapshot". It will by default run once a day and take snapshots, and it will keep 7 days worth of snapshots into the past. All those values are configurable.

  • backup-warden

    Streamline your backup management with ease and simplicity

  • Project mention: Backup Warden - a new tool for managing your backups | /r/mysql | 2023-07-01

    Hello everyone, I wanted to share with you a project I've been working on called Backup Warden. I know many of you most likely already have a process in place to manage your backups, but if you're looking for a more advanced solution or if your backups are running wild with no retention policy in place, Backup Warden might be worth considering. Unlike some other tools, Backup Warden is capable of working with various storage options, including local, S3, and SSH. It also provides a plethora of options to meet different backup needs. If it doesn't have a specific feature you're looking for or doesn't work as expected, I encourage you to share your feedback. You can open a request or even create a pull request to contribute. Your input will help me improve the tool :) Thank you for your time, and please let me know if you have any questions.

  • EnderChest

    syncing and linking for all your Minecraft instances

  • cartridge-backup

    Script to make incremental backups onto multiple, smaller drives from one larger source

  • borgctl

    borgctl - borgbackup without bash scripts

  • Project mention: Borgctl – borgbackup without bash scripts | news.ycombinator.com | 2024-02-07
  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python Backups related posts

Index

What are some of the best open-source Backup projects in Python? This list will help you:

Project Stars
1 ArchiveBox 19,737
2 BorgBackup 10,506
3 Bup 7,075
4 wal-e 3,423
5 Back In Time 1,838
6 Barman 1,836
7 Attic 1,112
8 Rdiff-backup 1,039
9 zfs_autobackup 520
10 hcloud-snapshot-as-backup 80
11 Duplicity 50
12 AWS-Automated-Daily-Instance-AMI-Snapshots 43
13 backup-warden 13
14 EnderChest 3
15 cartridge-backup 2
16 borgctl 1

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com