InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now. Learn more →
Top 16 Go Cloud Storage Projects
-
rclone
"rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Azure Blob, Azure Files, Yandex Files
Project mention: Two guys hated using Comcast, so they built their own fiber ISP | news.ycombinator.com | 2025-07-14Just offering some advice if you aren't aware. If you are, freely ignore.
For convenience, the rclone tool is nice for most cloud storage like google and stuff that make rsync annoying[0]
rsync also offers compression[1], and you might want to balance it depending if you want to be CPU bound or IO bound. You can pick the compression and level, with more options than just the `-z` flag. You can also increase speed by not doing the checksum, or by running without checksum and then running again later with. Or some intervaling like daily backups without and monthly you do checksums.
If you tar your files up first I have a function that is essentially `tar cf - "${@:2}" | xz -9 --threads $NTHREADS --verbose > "${1}"` which uses the maximum `xz` compression level. I like to heavily compress things upstream because it also makes downloads faster and decompression is much easier than compression. I usually prefer being compute bound.
Also, a systemd job is always nice and offers more flexibility than cron. It's what's helped me most with the wack-a-mole game. I like to do on calendar events (e.g. Daily, Weekly) and add a random delay. It's also nice that if the event was missed because the machine was off it'll run the job once the machine is back on (I usually make it wait at least 15 minutes after machine comes online).
[0] https://rclone.org/
[1] https://unix.stackexchange.com/a/292020
-
InfluxDB
InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
-
Project mention: Cloudreve: Self-hosted file management system with muilt-cloud support | news.ycombinator.com | 2025-05-03
-
SFTPGo
Full-featured and highly configurable SFTP, HTTP/S, FTP/S and WebDAV server - S3, Google Cloud Storage, Azure Blob
[ ] Use a WebDAV server that has a RESTful API: SFTPGo, for example.
-
Project mention: Streaming Data from Cloud Storage with Mountpoint for Amazon S3 | dev.to | 2025-02-11
# install goofys\ sudo curl -Lo \\ /usr/local/bin/goofys \\ https://github.com/kahing/goofys/releases/latest/download/goofys\ sudo chmod +x /usr/local/bin/goofys # install mount-s3\ wget \\ https://s3.amazonaws.com/mountpoint-s3-release/latest/x86_64/mount-s3.deb\ sudo dpkg -i mount-s3.deb\ sudo apt-get install -f -y
-
-
-
-
Stream
Stream - Scalable APIs for Chat, Feeds, Moderation, & Video. Stream helps developers build engaging apps that scale to millions with performant and flexible Chat, Feeds, Moderation, and Video APIs and SDKs powered by a global edge network and enterprise-grade infrastructure.
-
Project mention: ⛈️ Cloud Penetration Testing: A Practical Guide to Securing Your Cloud Infrastructure | dev.to | 2024-12-03
# Clone and setup CloudBrute git clone https://github.com/0xsha/CloudBrute cd CloudBrute # Run a scan against a target domain ./CloudBrute -d target.com -k wordlist.txt -m storage -t 80
-
gokv
Simple key-value store abstraction and implementations for Go (Redis, Consul, etcd, bbolt, BadgerDB, LevelDB, Memcached, DynamoDB, S3, PostgreSQL, MongoDB, CockroachDB and many more)
-
-
zfsbackup-go
Backup ZFS snapshots to cloud storage such as Google, Amazon, Azure, etc. Built with the enterprise in mind.
-
terraform-provider-iterative
☁️ Terraform plugin for machine learning workloads: spot instance recovery & auto-termination | AWS, GCP, Azure, Kubernetes
-
-
-
-
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
Go Cloud Storage discussion
Go Cloud Storage related posts
-
Two guys hated using Comcast, so they built their own fiber ISP
-
Cloudreve: Self-hosted file management system with muilt-cloud support
-
Dropbox will require App Indicator support on Linux
-
Rclone – open-source, multi threaded, command line tool for sending data
-
Google change is breaking some digital photo frames
-
Show HN: WinCse – Integrating AWS S3 with Windows Explorer
-
Ask HN: What's the best way to de-Google photos?
-
A note from our sponsor - InfluxDB
www.influxdata.com | 15 Jul 2025
Index
What are some of the best open-source Cloud Storage projects in Go? This list will help you:
| # | Project | Stars |
|---|---|---|
| 1 | rclone | 51,481 |
| 2 | cloudreve | 24,016 |
| 3 | SFTPGo | 10,675 |
| 4 | goofys | 5,371 |
| 5 | cubefs | 5,143 |
| 6 | google-cloud | 4,286 |
| 7 | daptin | 1,861 |
| 8 | CloudBrute | 1,020 |
| 9 | gokv | 801 |
| 10 | storage | 607 |
| 11 | zfsbackup-go | 364 |
| 12 | terraform-provider-iterative | 295 |
| 13 | reva | 192 |
| 14 | harp | 152 |
| 15 | prvt | 120 |
| 16 | webdav | 1 |
Sponsored
InfluxDB – Built for High-Performance Time Series Workloads
InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
www.influxdata.com