Go Cloud Storage

Open-source Go projects categorized as Cloud Storage

Top 16 Go Cloud Storage Projects

Cloud Storage
  1. rclone

    "rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Azure Blob, Azure Files, Yandex Files

    Project mention: Two guys hated using Comcast, so they built their own fiber ISP | news.ycombinator.com | 2025-07-14

    Just offering some advice if you aren't aware. If you are, freely ignore.

    For convenience, the rclone tool is nice for most cloud storage like google and stuff that make rsync annoying[0]

    rsync also offers compression[1], and you might want to balance it depending if you want to be CPU bound or IO bound. You can pick the compression and level, with more options than just the `-z` flag. You can also increase speed by not doing the checksum, or by running without checksum and then running again later with. Or some intervaling like daily backups without and monthly you do checksums.

    If you tar your files up first I have a function that is essentially `tar cf - "${@:2}" | xz -9 --threads $NTHREADS --verbose > "${1}"` which uses the maximum `xz` compression level. I like to heavily compress things upstream because it also makes downloads faster and decompression is much easier than compression. I usually prefer being compute bound.

    Also, a systemd job is always nice and offers more flexibility than cron. It's what's helped me most with the wack-a-mole game. I like to do on calendar events (e.g. Daily, Weekly) and add a random delay. It's also nice that if the event was missed because the machine was off it'll run the job once the machine is back on (I usually make it wait at least 15 minutes after machine comes online).

    [0] https://rclone.org/

    [1] https://unix.stackexchange.com/a/292020

  2. InfluxDB

    InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.

    InfluxDB logo
  3. cloudreve

    🌩 Self-hosted file management and sharing system, supports multiple storage providers

    Project mention: Cloudreve: Self-hosted file management system with muilt-cloud support | news.ycombinator.com | 2025-05-03
  4. SFTPGo

    Full-featured and highly configurable SFTP, HTTP/S, FTP/S and WebDAV server - S3, Google Cloud Storage, Azure Blob

    Project mention: Debugging Data Pipelines: From Memory to File with WebDAV | dev.to | 2025-05-03

    [ ] Use a WebDAV server that has a RESTful API: SFTPGo, for example.

  5. goofys

    a high-performance, POSIX-ish Amazon S3 file system written in Go

    Project mention: Streaming Data from Cloud Storage with Mountpoint for Amazon S3 | dev.to | 2025-02-11

    # install goofys\ sudo curl -Lo \\ /usr/local/bin/goofys \\ https://github.com/kahing/goofys/releases/latest/download/goofys\ sudo chmod +x /usr/local/bin/goofys # install mount-s3\ wget \\ https://s3.amazonaws.com/mountpoint-s3-release/latest/x86_64/mount-s3.deb\ sudo dpkg -i mount-s3.deb\ sudo apt-get install -f -y

  6. cubefs

    cloud-native distributed storage

  7. google-cloud

    Google Cloud Client Libraries for Go.

  8. daptin

    Daptin - Backend As A Service - GraphQL/JSON-API Headless CMS

    Project mention: Exploring Goja: A Golang JavaScript Runtime | news.ycombinator.com | 2024-09-06
  9. Stream

    Stream - Scalable APIs for Chat, Feeds, Moderation, & Video. Stream helps developers build engaging apps that scale to millions with performant and flexible Chat, Feeds, Moderation, and Video APIs and SDKs powered by a global edge network and enterprise-grade infrastructure.

    Stream logo
  10. CloudBrute

    Awesome cloud enumerator

    Project mention: ⛈️ Cloud Penetration Testing: A Practical Guide to Securing Your Cloud Infrastructure | dev.to | 2024-12-03

    # Clone and setup CloudBrute git clone https://github.com/0xsha/CloudBrute cd CloudBrute # Run a scan against a target domain ./CloudBrute -d target.com -k wordlist.txt -m storage -t 80

  11. gokv

    Simple key-value store abstraction and implementations for Go (Redis, Consul, etcd, bbolt, BadgerDB, LevelDB, Memcached, DynamoDB, S3, PostgreSQL, MongoDB, CockroachDB and many more)

  12. storage

    A vendor-neutral storage library for Golang: Write once, run on every storage service.

  13. zfsbackup-go

    Backup ZFS snapshots to cloud storage such as Google, Amazon, Azure, etc. Built with the enterprise in mind.

  14. terraform-provider-iterative

    ☁️ Terraform plugin for machine learning workloads: spot instance recovery & auto-termination | AWS, GCP, Azure, Kubernetes

  15. reva

    WebDAV/gRPC/HTTP high performance server to link high level clients to storage backends

  16. harp

    Secret management by contract toolchain (by elastic)

  17. prvt

    🔐 Personal, end-to-end encrypted storage that works through your browser

  18. webdav

    file server written in go. (by rexlx)

  19. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Go Cloud Storage discussion

Log in or Post with

Go Cloud Storage related posts

  • Two guys hated using Comcast, so they built their own fiber ISP

    2 projects | news.ycombinator.com | 14 Jul 2025
  • Cloudreve: Self-hosted file management system with muilt-cloud support

    1 project | news.ycombinator.com | 3 May 2025
  • Dropbox will require App Indicator support on Linux

    1 project | news.ycombinator.com | 1 May 2025
  • Rclone – open-source, multi threaded, command line tool for sending data

    1 project | news.ycombinator.com | 22 Apr 2025
  • Google change is breaking some digital photo frames

    2 projects | news.ycombinator.com | 7 Mar 2025
  • Show HN: WinCse – Integrating AWS S3 with Windows Explorer

    2 projects | news.ycombinator.com | 20 Feb 2025
  • Ask HN: What's the best way to de-Google photos?

    2 projects | news.ycombinator.com | 25 Jan 2025
  • A note from our sponsor - InfluxDB
    www.influxdata.com | 15 Jul 2025
    InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now. Learn more →

Index

What are some of the best open-source Cloud Storage projects in Go? This list will help you:

# Project Stars
1 rclone 51,481
2 cloudreve 24,016
3 SFTPGo 10,675
4 goofys 5,371
5 cubefs 5,143
6 google-cloud 4,286
7 daptin 1,861
8 CloudBrute 1,020
9 gokv 801
10 storage 607
11 zfsbackup-go 364
12 terraform-provider-iterative 295
13 reva 192
14 harp 152
15 prvt 120
16 webdav 1

Sponsored
InfluxDB – Built for High-Performance Time Series Workloads
InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
www.influxdata.com