The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning. Learn more →
Top 23 Go Backup Projects
-
-
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
kopia
Cross-platform backup tool for Windows, macOS & Linux with fast, incremental backups, client-side end-to-end encryption, compression and data deduplication. CLI and GUI included.
-
timeliner
All your digital life on a single timeline, stored locally -- DEPRECATED, SEE TIMELINIZE (link below)
-
-
docker-volume-backup
Backup Docker volumes locally or to any S3, WebDAV, Azure Blob Storage, Dropbox or SSH compatible storage
-
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
clickhouse-backup
Tool for easy ClickHouse backup and restore using object storage for backup files.
-
-
kstone
Kstone is an etcd management platform, providing cluster management, monitoring, backup, inspection, data migration, visual viewing of etcd data, and intelligent diagnosis.
-
-
-
gemini
Automated backups of PersistentVolumeClaims in Kubernetes using VolumeSnapshots (by FairwindsOps)
-
zfsbackup-go
Backup ZFS snapshots to cloud storage such as Google, Amazon, Azure, etc. Built with the enterprise in mind.
-
-
-
-
jazigo
Jazigo is a tool written in Go for retrieving configuration for multiple devices, similar to rancid, fetchconfig, oxidized, Sweet.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
Project mention: Building a Managed Service Provider Business With Open Source | dev.to | 2024-04-04Restic - GitHub
Project mention: What is the proper, kubernetes native way of working with multiple clusters for DR, HA? | /r/kubernetes | 2023-07-07Openshift last I looked used Velero under the covers for the functionality, which works fine in standard kubernetes. Most if not all that Openshift does is Open source.
Project mention: DwarFS – The Deduplicating Warp-Speed Advanced Read-Only File System | news.ycombinator.com | 2024-04-11I think Kopia would be great for your use case
It has a great system to snapshot files but only store data if it's changed. I use it in an environment where I can't use something like zfs to snapshot data because I don't have the ability to make decisions about what filesystem we're using. It's been amazing, love it so much!
Heya! I'm the author of PhotoStructure, and my Google Photos account (before I started working on PhotoStructure) is about that size, too.
I wrote up some tips here: https://photostructure.com/faq/takeout/
This is what I did:
1. First try to fetch all your Google Photos via Takeout in one archive. If it fails (like it did for me), try different-sized .tgz archives. I had to use the 10 Gb option (using 50gb caused an internal-to-google error).
If that fails to work, the last resort is to manually create by-year albums, shove all photos from that year into that album, and do a takeout of just that album. Repeat as necessary for every year.
2. Install an app on your phone to *directly* upload the original photos and videos from your phone to your NAS/home server. I have several recommended apps here: https://photostructure.com/faq/how-do-i-safely-store-files/#...
At this point, you can still use Google Photos (for viewing and as a last-ditch backup), but your originals are safe (without all the Google Photo downsampling and metadata shenanigans), and you're free to use whatever self-hosted software you want (like PhotoStructure, but there are a ton of alternatives, as well).
FWIW, I also tried this software: https://github.com/mholt/timeliner -- it does what it can, but the files you get via the API has a bunch of metadata stripped from it. I even had captured-at times get mangled with older photos.
Project mention: WAL-G 3.0.0 – fast disaster recovery for Postgres | news.ycombinator.com | 2024-03-17
I am interested in coming up with a backup plan before I get too invested in this setup. I found the docker-volume-backup project that looks like it might be a possible solution. However I'm not sure how to implement it using docker swarm since I am new to all of this. I would be interested in learning what backup solution you use for your docker swarm servers.
I really like restic, and am personally happy to use it via the command line. It's very fast and efficient! However, I do wish there was better tooling / wrappers around it. For example, Pika Backup is a popular UI for Borg of which no equivalent exists for Restic. I'd love to be able to set something simple up on my partner's Macbook.
For my own purposes, I've been using a script I found on Github[0] for a while, but it only really supports Backblaze B2 AFAIK.[1]
I've been meaning to try autorestic[2] and resticprofile[3] as they are potentially more flexible than the script I'm currently using, and prestic[4] looks intriguing for my partner's use, but seems to have very few users. And the fact that there are so many competing tools makes it difficult to land on one.
[0] https://github.com/erikw/restic-automatic-backup-scheduler
[1] https://github.com/erikw/restic-automatic-backup-scheduler/i...
[2] https://github.com/cupcakearmy/autorestic
If you need a way to automate repository backups, I like gickup.
The main disadvantage with pure Restic is that you usually have to end up writing your own shell scripts for some configuration management because Restic itself has none of that.
Fortunately there is https://github.com/creativeprojects/resticprofile to solve that problem.
Project mention: Mariadb-operator: Run and operate MariaDB in a cloud native way on Kubernetes | news.ycombinator.com | 2023-12-14
Project mention: What do you recommend for automated EBS backups for EKS? | /r/kubernetes | 2023-06-26I found https://github.com/FairwindsOps/gemini but wondering if there are alternatives.
Project mention: How valuable is home lab automation when applying for Devops? | /r/devops | 2023-05-16Make a github private repo that pushes to S3. Just spending 5 minutes, I'd have one thing in the repo, your pdf resume which you commit as a pdf, then use a github action like git-s3-push (note: I haven't done due diligence on this, so use it at your own risk).
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
The latest post mention was on 2024-04-11.
Go Backup related posts
- WAL-G 3.0.0 – fast disaster recovery for Postgres
- Restic – Backups Done Right
- Data corruption issue in restic 0.16.3 with max compression
- Rclone syncs your files to cloud storage
- Restic – Simple Backups
- The Drive Stats of Backblaze Storage Pods
- Public Files not Autosaving- Lost all Chats/Characters on Update
-
A note from our sponsor - WorkOS
workos.com | 19 Apr 2024
Index
What are some of the best open-source Backup projects in Go? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | restic | 23,706 |
| 2 | velero | 8,212 |
| 3 | kopia | 6,241 |
| 4 | timeliner | 3,546 |
| 5 | wal-g | 3,040 |
| 6 | docker-volume-backup | 1,492 |
| 7 | gobackup | 1,296 |
| 8 | clickhouse-backup | 1,139 |
| 9 | autorestic | 1,079 |
| 10 | zrepl | 894 |
| 11 | gickup | 877 |
| 12 | kstone | 662 |
| 13 | k8up | 552 |
| 14 | resticprofile | 530 |
| 15 | Walrus | 477 |
| 16 | mariadb-operator | 348 |
| 17 | gemini | 320 |
| 18 | zfsbackup-go | 318 |
| 19 | gdg | 298 |
| 20 | etcd-backup-restore | 277 |
| 21 | knoxite | 276 |
| 22 | git-s3-push | 217 |
| 23 | jazigo | 210 |
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com