InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now. Learn more →
Top 23 Go Storage Projects
-
minio
MinIO is a high-performance, S3 compatible object store, open sourced under GNU AGPLv3 license.
MinIO also switched to AGPLv3 a while back, and they stated that “the AGPL license requires that all software connecting with MinIO be 100% open source for you/your users not to be in violation of the license.”[^1] Since Redis and MinIO are somewhat similar, (Both can be used to store and retrieve data. One uses a custom protocol. The other one uses an S3-compatible API.) Should I assume that this statement also applies to Redis?
[^1]: https://github.com/minio/minio/issues/13308#issuecomment-929...
-
InfluxDB
InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
-
thanos
Highly available Prometheus setup with long term storage capabilities. A CNCF Incubating project.
Project mention: Top 10 Prometheus Alternatives in 2024 [Includes Open-Source] | dev.to | 2024-10-22Thanos is a set of components that can be added to an existing Prometheus deployment to enable long-term storage and global query view.
-
git clone --single-branch --branch master https://github.com/rook/rook.git
-
Object Storage: JuiceFS, Minio
-
-
Sad. As a fan of Plan 9 myself it’s somewhat expected. The ideas are strong but there’s something about it all not quite catching on.
I regularly referred others to Upspin’s source tree [1] if they wondered about larger systems written in Go but weren’t too big and gross like Kubernetes.
[1]: https://github.com/upspin/upspin
-
storj
Ongoing Storj v3 development. Decentralized cloud object storage that is affordable, easy to use, private, and secure.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
Project mention: Syncing AWS S3 Storage Bucket Objects to LocalStack S3 Storage Bucket | dev.to | 2025-03-27
The local storage first approach is more performant as compared to the direct approach since the direct approach relies on xargs to achieve parallel transfers using sub-processes. One can spawn multiple separate sub processes using xargs -P N when N is the number of sub processes required. The sub process parallelism is great for S3 sync as this is an I/O bound task. In terms of speed, using xargs even with tuned parallelism can be slow. If you are looking to speed up syncs, you can use tools such as s5cmd which supports true multithreading. I will sure do a tutorial on s5cmd and do a benchmark to check how it compares to using xargs in parallel mode. The approach in this tutorial was not created with the context of large S3 storage buckets. If you have a tutorial on this please share. Thanks again for reaching to the end of this tutorial. Cheers!
-
On Windows, you can download the ZIP file from the Minio Client Releases page and extract it to a folder of your choice. Then add the binary to your PATH:
-
lotusdb
Most advanced key-value database written in Go, extremely fast, compatible with LSM tree and B+ tree.
-
Project mention: Introduction to Gitless GitOps: A New OCI-Centric and Secure Architecture | dev.to | 2025-04-16
For implementation, the OCI artifact manipulation client tool ORAS (CNCF Sandbox project) seems useful. Flux uses oras-go.
-
-
-
Project mention: Creating a Local Environment to Operate GCS Emulator from Flask | dev.to | 2025-01-03
fsouza/fake-gcs-server
-
IceFireDB
@IceFireLabs -> IceFireDB is a database built for web3.0 It strives to fill the gap between web2 and web3.0 with a friendly database experience, making web3 application data storage more convenient, and making it easier for web2 applications to achieve decentralization and data immutability.
-
-
-
-
-
-
-
-
zfs-localpv
Dynamically provision Stateful Persistent Node-Local Volumes & Filesystems for Kubernetes that is integrated with a backend ZFS data storage stack.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
Go Storage discussion
Go Storage related posts
-
Kubernetes Home lab: Setting up Storage (Rook and Ceph)
-
Embracing Open Standards in Cloud-Native Development
-
Show HN: Colanode, open-source and local-first Slack and Notion alternative
-
Transforming Your PDFs for RAG with Open Source Using Docling, Milvus, and Feast
-
OCI Registry as Storage (ORAS): Distribute Artifacts Across OCI Registries
-
OCI Registry as Storage
-
Turning Down Upspin Infrastructure
-
A note from our sponsor - InfluxDB
www.influxdata.com | 16 May 2025
Index
What are some of the best open-source Storage projects in Go? This list will help you:
| # | Project | Stars |
|---|---|---|
| 1 | minio | 52,431 |
| 2 | thanos | 13,495 |
| 3 | rook | 12,781 |
| 4 | juicefs | 11,573 |
| 5 | drive | 6,718 |
| 6 | upspin | 6,396 |
| 7 | storj | 3,104 |
| 8 | s5cmd | 3,048 |
| 9 | mc | 3,030 |
| 10 | lotusdb | 2,155 |
| 11 | oras | 1,725 |
| 12 | operator | 1,293 |
| 13 | ObjectBox Go Database | 1,218 |
| 14 | fake-gcs-server | 1,161 |
| 15 | IceFireDB | 1,127 |
| 16 | volsync | 768 |
| 17 | mariadb-operator | 647 |
| 18 | directpv | 646 |
| 19 | storage | 601 |
| 20 | csi-digitalocean | 594 |
| 21 | hwameistor | 575 |
| 22 | mort | 513 |
| 23 | zfs-localpv | 481 |
Sponsored
InfluxDB – Built for High-Performance Time Series Workloads
InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
www.influxdata.com