Go Cloud Storage

Open-source Go projects categorized as Cloud Storage
Edit details
Topics: #Golang #Go #S3 #Cloud #Storage
Collect and Analyze Billions of Data Points in Real Time
Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.
www.influxdata.com
Sponsored

Top 15 Go Cloud Storage Projects

  • rclone

    "rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Yandex Files

    Project mention: iCloud Drive silently deletes your content | news.ycombinator.com | 2023-09-23

    I use multiple cloud storage services for redundancy than periodically rsync from cloud storage to a local device for private, local backup using rclone[1]

    I’m sure there are downsides but I like the benefit of passive image backup and periodic sync.

    1 - https://rclone.org/

  • Cloudreve

    🌩支持多家云存储的云盘系统 (Self-hosted file management and sharing system, supports multiple storage providers)

    Project mention: Cool things to self host | /r/selfhosted | 2023-07-12

    Check this https://github.com/cloudreve/Cloudreve/blob/master/docker-compose.yml

  • SonarQube

    Static code analysis for 29 languages.. Your projects are multi-language. So is SonarQube analysis. Find Bugs, Vulnerabilities, Security Hotspots, and Code Smells so you can release quality code every time. Get started analyzing your projects today for free.

  • SFTPGo

    Fully featured and highly configurable SFTP server with optional HTTP/S, FTP/S and WebDAV support - S3, Google Cloud Storage, Azure Blob

    Project mention: HashiCorp Did It Backwards | news.ycombinator.com | 2023-09-07

    > Even these projects have gotten to a level of sophistication that it would implode without big tech support.

    The worst thing is that all this FAANG or VC backed companies make a lot of people believe that they are the only viable way.

    > Why do you think you don't see any interesting oss tech from hobbyists is these days?

    Actually not true, just an example, https://github.com/drakkan/sftpgo. But there are plenty of them.

  • goofys

    a high-performance, POSIX-ish Amazon S3 file system written in Go

    Project mention: AWS Announces Open Source Mountpoint for Amazon S3 | news.ycombinator.com | 2023-03-26

    How is this different than these other solutions?

    https://github.com/kahing/goofys

    https://github.com/s3fs-fuse/s3fs-fuse

  • cubefs

    CubeFS is a cloud native unstructured data storage

  • google-cloud

    Google Cloud Client Libraries for Go.

    Project mention: A common iterator pattern | /r/golang | 2023-03-29

    is this different from google’s? https://github.com/googleapis/google-cloud-go/wiki/Iterator-Guidelines

  • daptin

    Daptin - Backend As A Service - GraphQL/JSON-API Headless CMS

  • Mergify

    Updating dependencies is time-consuming.. Solutions like Dependabot or Renovate update but don't merge dependencies. You need to do it manually while it could be fully automated! Add a Merge Queue to your workflow and stop caring about PR management & merging. Try Mergify for free.

  • gokv

    Simple key-value store abstraction and implementations for Go (Redis, Consul, etcd, bbolt, BadgerDB, LevelDB, Memcached, DynamoDB, S3, PostgreSQL, MongoDB, CockroachDB and many more)

  • storage

    A vendor-neutral storage library for Golang: Write once, run on every storage service.

  • zfsbackup-go

    Backup ZFS snapshots to cloud storage such as Google, Amazon, Azure, etc. Built with the enterprise in mind.

  • terraform-provider-iterative

    ☁️ Terraform plugin for machine learning workloads: spot instance recovery & auto-termination | AWS, GCP, Azure, Kubernetes

    Project mention: Using Ansible to create Deep Learning VM | /r/mlops | 2023-01-22

    You should look at terraform, and at the provider from iterative, the guys begind DVC, https://registry.terraform.io/providers/iterative/iterative/latest/docs

  • reva

    IOP (Inter Operability Platform)

  • harp

    Secret management by contract toolchain (by elastic)

  • prvt

    🔐 Personal, end-to-end encrypted storage that works through your browser

    Project mention: Share Your Code.. Share your most unique piece of Go code. | /r/golang | 2022-10-15

    prvt Personal, encrypted storage (which can be accessed through a browser)

  • webdav

    file server written in go. (by rexlx)

  • InfluxDB

    Collect and Analyze Billions of Data Points in Real Time. Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2023-09-23.

Go Cloud Storage related posts

Index

What are some of the best open-source Cloud Storage projects in Go? This list will help you:

Project Stars
1 rclone 40,346
2 Cloudreve 18,962
3 SFTPGo 6,800
4 goofys 4,817
5 cubefs 3,704
6 google-cloud 3,362
7 daptin 1,728
8 gokv 579
9 storage 466
10 zfsbackup-go 308
11 terraform-provider-iterative 286
12 reva 149
13 harp 142
14 prvt 109
15 webdav 0

Sponsored
Collect and Analyze Billions of Data Points in Real Time
Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.
www.influxdata.com