Top 13 Go Cloud Storage Projects
-
rclone
"rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Yandex Files
Ideally, you'd want a local backup server or a NAS plus another copy in cloud (or offsite). Cloud is usually easier to arrange but depends on your uplink speed. You can do for example Veeam for local backups and then combine it with Starwinds VTL: https://www.starwindsoftware.com/starwind-virtual-tape-library-free or Rclone: https://rclone.org/ to copy backups to cloud.
-
Cloudreve
🌩支持多家云存储的云盘系统 (Self-hosted file management and sharing system, supports multiple storage providers)
Project mention: [File-Sharing] Does anyone heard of CloudReve ? | reddit.com/r/selfhosted | 2021-08-18 -
JetBrains
Developer Ecosystem Survey 2022. Take part in the Developer Ecosystem Survey 2022 by JetBrains and get a chance to win a Macbook, a Nvidia graphics card, or other prizes. We’ll create an infographic full of stats, and you’ll get personalized results so you can compare yourself with other developers.
-
SFTPGo
Fully featured and highly configurable SFTP server with optional HTTP/S, FTP/S and WebDAV support - S3, Google Cloud Storage, Azure Blob
maybe you could install SFTPGo
-
Project mention: How do you manage large training datasets? | reddit.com/r/computervision | 2022-06-02
So, we just need to change the dataloader function a bit to make this work then. Did you try just mounting S3 using https://github.com/kahing/goofys. In this case, we need not even change the dataloader code. Not sure of the performance though.
-
I would go with GCP. There are Go examples everywhere in the GCP documentation and here is the official Go lib for GCP https://github.com/googleapis/google-cloud-go
-
-
gokv
Simple key-value store abstraction and implementations for Go (Redis, Consul, etcd, bbolt, BadgerDB, LevelDB, Memcached, DynamoDB, S3, PostgreSQL, MongoDB, CockroachDB and many more)
-
Scout APM
Less time debugging, more time building. Scout APM allows you to find and fix performance issues with no hassle. Now with error monitoring and external services monitoring, Scout is a developer's best friend when it comes to application development.
-
-
zfsbackup-go
Backup ZFS snapshots to cloud storage such as Google, Amazon, Azure, etc. Built with the enterprise in mind.
-
terraform-provider-iterative
☁️ Terraform plugin for machine learning workloads: spot instance recovery & auto-termination | AWS, GCP, Azure, Kubernetes
Project mention: Terraform Provider Iterative (TPI) - a CLI tool offering full lifecycle management of computing resources from several cloud vendors (AWS, Azure, GCP, K8s) for machine learning | reddit.com/r/Terraform | 2022-05-24TPI tool offers full lifecycle management of computing resources (including GPUs and respawning spot instances) from several cloud vendors (AWS, Azure, GCP, K8s) without needing to be a cloud expert: Terraform Provider Iterative (TPI) - Terraform Registry
-
Project mention: Harp v0.2.5 - Secret management by contract - PEM/JWT/TLSA template functions and GitHub Actions secret exporter. | reddit.com/r/golang | 2022-01-28
Page is 404ing for me. Here’s the link the repo: https://github.com/elastic/harp/
-
Project mention: Developing a Web App with Gin framework, integrating it with psql DB and my GO HACK Hackathon Experience | dev.to | 2022-05-26
Before I deep dive into the architecture of what I rebuilt the app during the hackathon, I would like to tell about my experiences in my words. When I first came across #GO Hack Challenge on devpost, I was overwhelming to find related tracks which I could be fit for and tutorials to enrich my knowledge here and there to get into it. It was really a learning opportunity to someone who is newbie and contribute or build any stuff under the hood. I stepped into the open source projects under CERN Foundation, where I didn’t even know what the ecosystem around the project is. I was much curious then. Next, I delved into one of the projects for a few days and looked into a few issues and made a small contribution to it by fixing one of the bugs. I moved to another track where we needed to build any app based on golang. I came to know about use of generic function which is currently released and used in Go >= 18 Version. I managed to rebuild an app using Gin-Gonic framework and use the generic function usage in my app.
-
Go Cloud Storage related posts
Index
What are some of the best open-source Cloud Storage projects in Go? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | rclone | 33,436 |
| 2 | Cloudreve | 15,011 |
| 3 | SFTPGo | 4,414 |
| 4 | goofys | 4,196 |
| 5 | google-cloud | 2,934 |
| 6 | daptin | 1,576 |
| 7 | gokv | 438 |
| 8 | storage | 361 |
| 9 | zfsbackup-go | 249 |
| 10 | terraform-provider-iterative | 231 |
| 11 | harp | 131 |
| 12 | reva | 118 |
| 13 | webdav | 1 |
Are you hiring? Post a new remote job listing for free.
