Top 23 Go Distributed System Projects
Distributed reliable key-value store for the most critical data of a distributed systemProject mention: Cannot connect to OpenShift cluster using oc tool and admin console. | reddit.com/r/openshift | 2021-06-09
I found this issue https://github.com/etcd-io/etcd/issues/11949
A realtime distributed messaging platformProject mention: For those running Go in production at scale, what do you use for distributed task queues? | reddit.com/r/golang | 2021-06-04
Here is link number 1 - Previous text "NSQ"
Scout APM - Leading-edge performance monitoring starting at $39/month. Scout APM uses tracing logic that ties bottlenecks to source code so you know the exact line of code causing performance issues and can get back to building a great product faster.
Go Micro is a framework for distributed systems developmentProject mention: Why and how we built Distributed with Next.js and Micro | dev.to | 2021-03-26
The Go language implementation of gRPC. HTTP/2 based RPCProject mention: Killing PubSub connection when client of server side stream dies in go | reddit.com/r/golang | 2021-04-30
SeaweedFS is a distributed storage system for blobs, objects, files, and data lake, to store and serve billions of files fast! Blob store has O(1) disk seek, local tiering, cloud tiering. Filer supports cross-cluster active-active replication, Kubernetes, POSIX, S3 API, encryption, Erasure Coding for warm storage, FUSE mount, Hadoop, WebDAV.Project mention: Three node system needs low latency distributed storage | reddit.com/r/homelab | 2021-06-17
SeaweedFS has been bookmarked for a while but I haven't had a chance to play with it. But 100ms between nodes is an architecture problem, not a software problem (IMO).
Micro is a distributed OS built for the Cloud (by micro)Project mention: Micro - A platform for microservices development | reddit.com/r/microservices | 2021-04-16
High-Performance server for NATS.io, the cloud and edge native messaging system.Project mention: [HIRING] Senior Backend Developer (Golang) at Valocode (Helsinki, Finland) | Salary: 60k-70k EUR - depending on equity package | reddit.com/r/RemoteJobs | 2021-05-31
About the role: You will have a crucial role in developing the Bubbly backend which is entirely written in Golang. We are using NATS (https://nats.io) and a service-oriented architecture (not quite microservice) where the services communicate via NATS message queues. Postgres is the primary database right now, but we have plans for immutable, append-only databases in the future for more compliance-related activities. As the team was founded from a DevOps company, Verifa, we enjoy our DevOps practices and would hope you will enjoy it also.
Run Linux Software Faster and Safer than Linux with Unikernels.
go-zero is a web and rpc framework written in Go. It's born to ensure the stability of the busy sites with resilient design. Builtin goctl greatly improves the development productivity.Project mention: Any idea on developing an IDL to simplify the restful API development? | news.ycombinator.com | 2021-05-31
Nomad is an easy-to-use, flexible, and performant workload orchestrator that can deploy a mix of microservice, batch, containerized, and non-containerized applications. Nomad is easy to operate and scale and has native Consul and Vault integrations.Project mention: Replit used legal threats to kill my open-source project | news.ycombinator.com | 2021-06-07
I would look at how the major clouds are running their compute instances. This might help:
I think you will end up needing VMs. I have been thinking of using Tekton to make a CI/CD service but I would pretty much need to smash the whole k8s VM/Node every time I do something and only allow one participant at a time.
The lightweight, distributed relational database built on SQLiteProject mention: Comparing rqlite with tidb and any other distributed sql server alternatives? | reddit.com/r/golang | 2021-06-10
Does anyone know production deployment of rqlite, how stable it is, and how well does it scale?
Best microservices framework in Go, like alibaba Dubbo, but with more features, Scale easily. Try it. Test it. If you feel it's better, use it! 𝐉𝐚𝐯𝐚有𝐝𝐮𝐛𝐛𝐨, 𝐆𝐨𝐥𝐚𝐧𝐠有𝐫𝐩𝐜𝐱!
Distributed, offline-first bug tracker embedded in git, with bridgesProject mention: Go is powering enterprise developers: Developer survey results | reddit.com/r/golang | 2021-04-23
It's my general experience working on various/complex software and with talented people. For the more go specific part, writing https://github.com/MichaelMure/git-bug.
Cadence is a distributed, scalable, durable, and highly available orchestration engine to execute asynchronous long-running business logic in a scalable and resilient way.Project mention: For those running Go in production at scale, what do you use for distributed task queues? | reddit.com/r/golang | 2021-06-04
We use cadence https://github.com/uber/cadence
Golang implementation of the Raft consensus protocol
Kafka implemented in Golang with built-in coordination (No ZK dep, single binary install, Cloud Native)
Ultra performant API Gateway with middlewares. A project hosted at The Linux FoundationProject mention: Authelia is an open-source authentication/authorization server with 2FA/SSO | news.ycombinator.com | 2021-03-10
Thanks for the pointer to Express API Gateway.
A took a look at Krakend a while back, and it didn't seem to support it either 
⟁ Tendermint Core (BFT Consensus) in GoProject mention: EIP1559 is going live soon. Here’s what it means for Ethereum. | reddit.com/r/CryptoCurrency | 2021-06-15
Full-featured BitTorrent client package and utilitiesProject mention: Getting torrent file hash | reddit.com/r/golang | 2021-04-27
I haven't vetted this library, but https://github.com/anacrolix/torrent looks useful.
A feature complete and high performance multi-group Raft library in Go.
JuiceFS is a distributed POSIX file system built on top of Redis and S3.Project mention: "JuiceFS is an open-source POSIX file system built on top of Redis and object storage (e.g. Amazon S3), designed and optimized for cloud native environment." | reddit.com/r/programming | 2021-04-20
Glow is an easy-to-use distributed computation system written in Go, similar to Hadoop Map Reduce, Spark, Flink, Storm, etc. I am also working on another similar pure Go system, https://github.com/chrislusf/gleam , which is more flexible and more performant. (by chrislusf)
High performance, distributed and low latency publish-subscribe platform.
Fast, efficient, and scalable distributed map/reduce system, DAG execution, in memory or on disk, written in pure Go, runs standalone or distributedly. (by chrislusf)
What are some of the best open-source Distributed System projects in Go? This list will help you:
|5||Seaweed File System||12,177|