Go Distributed Systems

Open-source Go projects categorized as Distributed Systems | Edit details

Top 23 Go Distributed System Projects

  • GitHub repo etcd

    Distributed reliable key-value store for the most critical data of a distributed system

    Project mention: etcd | reddit.com/r/JavaOnTheEdge | 2021-11-07
  • GitHub repo nsq

    A realtime distributed messaging platform

    Project mention: Fluvio: The Programmable Data Platform | news.ycombinator.com | 2021-07-10

    If we are talking about "cloud-native", I would really recommend taking a look at nsq or nats. I am really big fanboy of NSQ [1], it is simple, easy to setup and conceptually easy to learn.

    [1] https://nsq.io

  • Scout APM

    Scout APM: A developer's best friend. Try free for 14-days. Scout APM uses tracing logic that ties bottlenecks to source code so you know the exact line of code causing performance issues and can get back to building a great product faster.

  • GitHub repo go-micro

    A pluggable Go framework for distributed systems development

    Project mention: Show HN: Go Micro – a Go framework for distributed systems development | news.ycombinator.com | 2021-11-01
  • GitHub repo grpc-go

    The Go language implementation of gRPC. HTTP/2 based RPC

    Project mention: Explanation of context in go? | reddit.com/r/golang | 2021-11-08
  • GitHub repo Seaweed File System

    SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.

    Project mention: SeaweedFS uses skip list on Redis to store millions of files in one directory. | reddit.com/r/filesystems | 2021-10-11
  • GitHub repo micro

    Micro is a distributed cloud operating system (by micro)

    Project mention: Next.js 12 | news.ycombinator.com | 2021-10-26
  • GitHub repo Nomad

    Nomad is an easy-to-use, flexible, and performant workload orchestrator that can deploy a mix of microservice, batch, containerized, and non-containerized applications. Nomad is easy to operate and scale and has native Consul and Vault integrations.

    Project mention: Creating GCP disk images with (for?) TerraForm | reddit.com/r/devops | 2021-11-23

    Also if you don’t want to look at kube then check out Nomad. https://www.nomadproject.io/

  • Nanos

    Run Linux Software Faster and Safer than Linux with Unikernels.

  • GitHub repo NATS

    High-Performance server for NATS.io, the cloud and edge native messaging system.

    Project mention: Processing billions of events in real time at Twitter | news.ycombinator.com | 2021-11-15

    NATS is built with golang which is one of the reasons I like it…

    https://github.com/nats-io/nats-server

  • GitHub repo rqlite

    The lightweight, distributed relational database built on SQLite

    Project mention: Cloudflare Durable Objects Are Now Generally Available | news.ycombinator.com | 2021-11-15
  • GitHub repo rpcx

    Best microservices framework in Go, like alibaba Dubbo, but with more features, Scale easily. Try it. Test it. If you feel it's better, use it! 𝐉𝐚𝐯𝐚有𝐝𝐮𝐛𝐛𝐨, 𝐆𝐨𝐥𝐚𝐧𝐠有𝐫𝐩𝐜𝐱!

  • GitHub repo cadence

    Cadence is a distributed, scalable, durable, and highly available orchestration engine to execute asynchronous long-running business logic in a scalable and resilient way.

    Project mention: For those running Go in production at scale, what do you use for distributed task queues? | reddit.com/r/golang | 2021-06-04

    We use cadence https://github.com/uber/cadence

  • GitHub repo git-bug

    Distributed, offline-first bug tracker embedded in git, with bridges

    Project mention: Utterances – a lightweight comments widget built on GitHub issues | news.ycombinator.com | 2021-11-11

    I think he meant just the network effects of a social platform. Github has more people in them so there are more people interacting with repositories hosted on Github.

    I wish that somehow people carried identity across Github / Gitlab / Gitea / other services. Like, a federated issue tracker. Or otherwise that the issues themselves were easily movable between platforms, with no lock-in. But the incumbent platforms rarely want something like this.

    An alternative is to eschew platform issues entirely, and use decentralized issue comments hosted as Git repositories, like https://github.com/dspinellis/git-issue or https://github.com/neithernut/git-dit or https://github.com/MichaelMure/git-bug - I think that Gitlab should offer integration with one of them. I mean: both allowing to export issues and PRs into a Git branch, and allowing people to comment on issues and PRs by pushing to a Git branch.

  • GitHub repo pachyderm

    Reproducible Data Science at Scale!

    Project mention: Dud: a tool for versioning data alongside source code, written in Go | reddit.com/r/golang | 2021-06-21
  • GitHub repo raft

    Golang implementation of the Raft consensus protocol

    Project mention: Raft Consensus Protocol | news.ycombinator.com | 2021-11-04

    In general Hashicorp's repos are high quality:

    https://github.com/hashicorp/raft

    Example application: https://github.com/Jille/raft-grpc-example

  • GitHub repo KrakenD

    Ultra performant API Gateway with middlewares. A project hosted at The Linux Foundation

    Project mention: Authelia is an open-source authentication/authorization server with 2FA/SSO | news.ycombinator.com | 2021-03-10

    Thanks for the pointer to Express API Gateway.

    A took a look at Krakend a while back, and it didn't seem to support it either [1]

    [1] https://github.com/devopsfaith/krakend/issues/274

  • GitHub repo tendermint

    ⟁ Tendermint Core (BFT Consensus) in Go

    Project mention: SubscribeStar Update (Nov 01, 2021 12:35 PM) | reddit.com/r/BitChute | 2021-11-01

    Blockchain Implementing Tendermint to create permanent, decentralized list of references to BC content.

  • GitHub repo Jocko

    Kafka implemented in Golang with built-in coordination (No ZK dep, single binary install, Cloud Native)

    Project mention: ZooKeeper-free Kafka is out. First Demo | news.ycombinator.com | 2021-03-30

    Reminded me of this project: https://github.com/travisjeffery/jocko

    Kafka implemented in Go without needing Zookeeper.

  • GitHub repo juicefs

    JuiceFS is a distributed POSIX file system built on top of Redis and S3.

    Project mention: Ask HN: What are you using for public documentation these days? | news.ycombinator.com | 2021-11-18

    [2] https://github.com/juicedata/juicefs/blob/main/docs/en/how_t...

  • GitHub repo torrent

    Full-featured BitTorrent client package and utilities

    Project mention: exatorrent - Self-hostable , easy-to-use , lightweight and feature-rich torrent client written in Go | reddit.com/r/seedboxes | 2021-08-27
  • GitHub repo dragonboat

    A feature complete and high performance multi-group Raft library in Go.

  • GitHub repo emitter-io

    High performance, distributed and low latency publish-subscribe platform.

  • GitHub repo temporal

    Temporal service and CLI

    Project mention: Temporalio/temporal: Temporal service and CLI | news.ycombinator.com | 2021-06-11
  • GitHub repo glow

    Glow is an easy-to-use distributed computation system written in Go, similar to Hadoop Map Reduce, Spark, Flink, Storm, etc. I am also working on another similar pure Go system, https://github.com/chrislusf/gleam , which is more flexible and more performant. (by chrislusf)

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2021-11-23.

Go Distributed Systems related posts

Index

What are some of the best open-source Distributed System projects in Go? This list will help you:

Project Stars
1 etcd 37,977
2 nsq 20,539
3 go-micro 17,204
4 grpc-go 14,909
5 Seaweed File System 13,193
6 micro 10,710
7 Nomad 10,261
8 NATS 10,137
9 rqlite 9,071
10 rpcx 6,393
11 cadence 5,451
12 git-bug 5,411
13 pachyderm 5,287
14 raft 5,264
15 KrakenD 4,679
16 tendermint 4,441
17 Jocko 4,422
18 juicefs 4,159
19 torrent 4,102
20 dragonboat 3,938
21 emitter-io 3,105
22 temporal 3,049
23 glow 2,994
Find remote jobs at our new job board 99remotejobs.com. There are 34 new remote jobs listed recently.
Are you hiring? Post a new remote job listing for free.
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com