The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning. Learn more →
Top 23 Backup Open-Source Projects
-
90DaysOfDevOps
This repository started out as a learning in public project for myself and has now become a structured learning map for many in the community. We have 3 years under our belt covering all things DevOps, including Principles, Processes, Tooling and Use Cases surrounding this vast topic.
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
kopia
Cross-platform backup tool for Windows, macOS & Linux with fast, incremental backups, client-side end-to-end encryption, compression and data deduplication. CLI and GUI included.
-
s3cmd
Official s3cmd repo -- Command line tool for managing S3 compatible storage services (including Amazon S3 and CloudFront).
-
all-in-one
📦 The official Nextcloud installation method. Provides easy deployment and maintenance with most features included in this one Nextcloud instance.
-
timeliner
All your digital life on a single timeline, stored locally -- DEPRECATED, SEE TIMELINIZE (link below)
-
Rsnapshot
a tool for backing up your data using rsync (if you want to get help, use https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss)
-
xLog
Android logger, pretty, powerful and flexible, log to everywhere, save to file, all you want is here. (by elvishew)
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
90DaysOfDevOps 2022
Project mention: Building a Managed Service Provider Business With Open Source | dev.to | 2024-04-04Restic - GitHub
Project mention: Ask HN: Open-source Windows 11 backup solutions | news.ycombinator.com | 2024-04-04i use - and recommend - "borgbackup": for example with the "vorta" graphical frontend
* https://www.borgbackup.org/
* https://vorta.borgbase.com/install/windows/
just my 0.02€
Petabaytlarca veri emanet edilen şu kodun %85'i C# https://github.com/duplicati/duplicati
Project mention: What is the proper, kubernetes native way of working with multiple clusters for DR, HA? | /r/kubernetes | 2023-07-07Openshift last I looked used Velero under the covers for the functionality, which works fine in standard kubernetes. Most if not all that Openshift does is Open source.
Project mention: how can i delete 15 days data from elasticsearch cloud and move to s3? | /r/elasticsearch | 2023-06-15If you're wanting to take data out of Elasticsearch completely and make it readable via other tools you could look at ElasticDump, it supports export to S3 as well as the ability to delete documents as they're exported. https://github.com/elasticsearch-dump/elasticsearch-dump
Project mention: DwarFS – The Deduplicating Warp-Speed Advanced Read-Only File System | news.ycombinator.com | 2024-04-11I think Kopia would be great for your use case
https://kopia.io/
It has a great system to snapshot files but only store data if it's changed. I use it in an environment where I can't use something like zfs to snapshot data because I don't have the ability to make decisions about what filesystem we're using. It's been amazing, love it so much!
Project mention: Backup VS database - a user suggested alternative | libhunt.com/r/backup | 2023-06-21
Project mention: Amazon S3 Tools: Command Line S3 Client and S3 Backup | news.ycombinator.com | 2024-01-26
Project mention: 15 open-source tools to elevate your software design workflow | dev.to | 2024-01-22Link | Demo | Github | License
Heya! I'm the author of PhotoStructure, and my Google Photos account (before I started working on PhotoStructure) is about that size, too.
I wrote up some tips here: https://photostructure.com/faq/takeout/
This is what I did:
1. First try to fetch all your Google Photos via Takeout in one archive. If it fails (like it did for me), try different-sized .tgz archives. I had to use the 10 Gb option (using 50gb caused an internal-to-google error).
If that fails to work, the last resort is to manually create by-year albums, shove all photos from that year into that album, and do a takeout of just that album. Repeat as necessary for every year.
2. Install an app on your phone to *directly* upload the original photos and videos from your phone to your NAS/home server. I have several recommended apps here: https://photostructure.com/faq/how-do-i-safely-store-files/#...
At this point, you can still use Google Photos (for viewing and as a last-ditch backup), but your originals are safe (without all the Google Photo downsampling and metadata shenanigans), and you're free to use whatever self-hosted software you want (like PhotoStructure, but there are a ton of alternatives, as well).
FWIW, I also tried this software: https://github.com/mholt/timeliner -- it does what it can, but the files you get via the API has a bunch of metadata stripped from it. I even had captured-at times get mangled with older photos.
Do you have other apps installed? Go into the package center and stop stuff. Your issue isn't corruption it's the old and not very powerful hardware (and possibly your drives) not being enough for the workload. If you want to try a different app there is a docker solution https://github.com/gaubert/gmvault
See the GitHub: https://github.com/wal-e/wal-e
Unmaintained would’ve made more sense to say, but the maintainer choose the words “obsolete” so I took those. :)
Seems to be obsolete due to a lack of interest and contributions.
Project mention: Python Port of 600 Line Bash Script: rsync-time-machine.py for Rsync Backups | news.ycombinator.com | 2023-05-13Hi Hacker News,
I'm excited to share my recent project, where I took on the challenge of porting a popular but untested 600+ line Bash script to Python. The outcome is [`rsync-time-machine.py`](https://github.com/basnijholt/rsync-time-machine.py), a Python implementation of the [`rsync-time-backup`](https://github.com/laurent22/rsync-time-backup) script. It provides Time Machine-style backups using rsync and creates incremental backups of files and directories to the destination of your choice.
The tool is designed to work on Linux, macOS, and Windows (via WSL or Cygwin). Its advantage over Time Machine is its flexibility - it can backup from/to any filesystem and works on any platform. You can also backup to a Truecrypt drive without any issues.
Unlike the original Bash script, `rsync-time-machine.py` is fully tested. It has no external dependencies (only requires Python ≥3.7), and it is fully compatible with [`rsync-time-backup`](https://github.com/laurent22/rsync-time-backup). It offers pretty terminal output and is fully typed.
Key features include:
* Each backup is in its own folder named after the current timestamp.
Two things I want to try this month are:
https://mastodon.social/@chromakode/110936177254839251
https://rsnapshot.org/
Project mention: WAL-G 3.0.0 – fast disaster recovery for Postgres | news.ycombinator.com | 2024-03-17
29. October 2021 At this point Jia Tan pops up, and the first thing we see from him is an innocuous patch to the xz repository, and while a lot of people believe he started out trying his luck with another library also known as libarchive, this is not the case, I would bet it’s more of a backup looking at the dates, being that there are a few days in between as shown in this commit.
after using expect and TCL heavily for years, I can firmly say they suck at scale.
Ruby https://github.com/ytti/oxidized/blob/master/lib/oxidized/mo...
Backup related posts
- I switched from Notion to Obsidian
- The XZ attack and timeline
- Better Adb-Shell
- Ask HN: Open-source Windows 11 backup solutions
- Zip entry size unset now honors user requested compression level
- Backblaze Personal Wine Community Container
- Suspicious libarchive pull request
-
A note from our sponsor - WorkOS
workos.com | 25 Apr 2024
Index
What are some of the best open-source Backup projects? This list will help you:
Project | Stars | |
---|---|---|
1 | 90DaysOfDevOps | 25,803 |
2 | restic | 23,766 |
3 | BorgBackup | 10,526 |
4 | Duplicati | 10,184 |
5 | Bash-Snippets | 9,441 |
6 | velero | 8,212 |
7 | elasticsearch-dump | 7,317 |
8 | kopia | 6,270 |
9 | WechatExporter | 5,512 |
10 | laravel-backup | 5,492 |
11 | Backup | 4,817 |
12 | s3cmd | 4,418 |
13 | all-in-one | 4,088 |
14 | Replibyte | 3,990 |
15 | timeliner | 3,548 |
16 | gmvault | 3,538 |
17 | wal-e | 3,423 |
18 | rsync-time-backup | 3,307 |
19 | Rsnapshot | 3,080 |
20 | xLog | 3,039 |
21 | wal-g | 3,038 |
22 | libarchive | 2,870 |
23 | Oxidized | 2,611 |
Sponsored