Go Distributed Systems

Open-source Go projects categorized as Distributed Systems
Edit details
Topics: Golang Go Kubernetes Microservices Database
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured

Top 23 Go Distributed System Projects

  • etcd

    Distributed reliable key-value store for the most critical data of a distributed system

    • Project mention: Chaos (fault) testing method for etcd and MongoDB | dev.to | 2024-05-19

    so far, we have been able to do some fault simulation tests by using the fault points built in etcd. how to use these fault points can refer to the official integration test implementation of etcd-> etcd Robustness Testing. you can search for relevant codes by the name of the fault point.

  • nsq

    A realtime distributed messaging platform

    • Project mention: NSQ: Open-source realtime distributed messaging, billions of messages / day | news.ycombinator.com | 2024-01-09

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • go-micro

    A Go microservices framework

  • seaweedfs

    SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.

    • Project mention: Ask HN: What distributed file system would you use in 2024? | news.ycombinator.com | 2024-05-10

  • grpc-go

    The Go language implementation of gRPC. HTTP/2 based RPC

    • Project mention: Consistent Hashing: An Overview and Implementation in Golang | dev.to | 2024-05-07

    grpc-go: go get -u google.golang.org/grpc

  • rqlite

    The lightweight, distributed relational database built on SQLite.

    • Project mention: The lightweight, easy-to-use, distributed relational database built on SQLite | news.ycombinator.com | 2024-02-23

  • NATS

    High-Performance server for NATS.io, the cloud and edge native messaging system.

    • Project mention: Implementing OTel Trace Context Propagation Through Message Brokers with Go | dev.to | 2024-04-04

    Several message brokers, such as NATS and database queues, are not supported by OpenTelemetry (OTel) SDKs. This article will guide you on how to use context propagation explicitly with these message queues.

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo

  • Nomad

    Nomad is an easy-to-use, flexible, and performant workload orchestrator that can deploy a mix of microservice, batch, containerized, and non-containerized applications. Nomad is easy to operate and scale and has native Consul and Vault integrations.

    • Project mention: Ask HN: Are there any open source forks of nomad smd consul? | news.ycombinator.com | 2024-05-02

    Doesn't look like it.

    * https://github.com/hashicorp/nomad/forks

    * https://github.com/search?q=nomad%20fork&type=repositories

    * https://www.google.com/search?q=hashicorp+nomad+forks

    There are products that do similar things of course.

  • micro

    A Go service development platform (by micro)

    • Project mention: Micro – A Go service development platform | news.ycombinator.com | 2024-04-24

  • temporal

    Temporal service

    • Project mention: Rethinking Serverless with Flame | news.ycombinator.com | 2023-12-06

    I don't know if I agree with the argument regarding durability vs elastic execution. If I can get both (with a nice API/DX) via something like Temporal (https://github.com/temporalio/temporal), what's the drawback here?

  • juicefs

    JuiceFS is a distributed POSIX file system built on top of Redis and S3.

    • Project mention: Data Sync in JuiceFS 1.2: Enhanced Selective Sync and Performance Optimizations | dev.to | 2024-05-17

    In JuiceFS 1.2, we introduced several new features for juicefs sync. We also optimized performance for multiple scenarios to improve users' data synchronization efficiency when dealing with large directories and complex migrations.

  • git-bug

    Distributed, offline-first bug tracker embedded in git, with bridges

    • Project mention: Show HN: Tegon: AI-first, open source alternative to Jira, Linear | news.ycombinator.com | 2024-05-07

    I think git-bug[1] is the most popular project of that sort.

    [1]: https://github.com/MichaelMure/git-bug

  • rpcx

    Best microservices framework in Go, like alibaba Dubbo, but with more features, Scale easily. Try it. Test it. If you feel it's better, use it! 𝐉𝐚𝐯𝐚有𝐝𝐮𝐛𝐛𝐨, 𝐆𝐨𝐥𝐚𝐧𝐠有𝐫𝐩𝐜𝐱! build for cloud!

  • raft

    Golang implementation of the Raft consensus protocol

    • Project mention: Leader election library | /r/golang | 2023-07-07

    Depending on your exact needs, you could try HashiCorp's Raft implementation: https://github.com/hashicorp/raft

  • cadence

    Cadence is a distributed, scalable, durable, and highly available orchestration engine to execute asynchronous long-running business logic in a scalable and resilient way.

    • Project mention: Show HN: Hatchet – Open-source distributed task queue | news.ycombinator.com | 2024-03-08

  • kitex

    Go RPC framework with high-performance and strong-extensibility for building micro-services.

    • Project mention: How to Visualize and Analyze Data in Open Source Communities | dev.to | 2024-04-21

    After successful deployment, the data display panel looks as follows. Here, we present statistics and displays of the open-source community CloudWeGo, a project by ByteDance. The panels include:

  • pachyderm

    Data-Centric Pipelines and Data Versioning

    • Project mention: Open Source Advent Fun Wraps Up! | dev.to | 2024-01-05

    20. Pachyderm | Github | tutorial

  • KrakenD

    Ultra performant API Gateway with middlewares. A project hosted at The Linux Foundation

  • easegress

    A Cloud Native traffic orchestration system

    • Project mention: Easegress: Cloud Native traffic orchestration system | news.ycombinator.com | 2024-01-17

  • tendermint

    ⟁ Tendermint Core (BFT Consensus) in Go

    • Project mention: On Implementation of Distributed Protocols | dev.to | 2024-04-05

    Tendermint Core / CometBFT — a state machine replication engine (written in Go);

  • torrent

    Full-featured BitTorrent client package and utilities

    • Project mention: BTFS (BitTorrent Filesystem) | news.ycombinator.com | 2024-04-15

    https://github.com/anacrolix/torrent has a fuse driver since 2013. I'm in the early stages of removing it. There are WebDAV, 3rd party FUSE, and HTTP wrappers of the client all doing similar things: serving magnet links, infohashes, and torrent files like an immutable filesystem. BitTorrent v2 support is currently in master.

  • gaia

    Build powerful pipelines in any programming language.

  • dragonboat

    A feature complete and high performance multi-group Raft library in Go.

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Go Distributed Systems related posts

Index

What are some of the best open-source Distributed System projects in Go? This list will help you:

Project Stars
1 etcd 46,505
2 nsq 24,605
3 go-micro 21,438
4 seaweedfs 21,243
5 grpc-go 19,970
6 rqlite 14,948
7 NATS 14,878
8 Nomad 14,468
9 micro 12,029
10 temporal 10,128
11 juicefs 9,851
12 git-bug 8,013
13 rpcx 7,961
14 raft 7,894
15 cadence 7,881
16 kitex 6,702
17 pachyderm 6,083
18 KrakenD 6,094
19 easegress 5,701
20 tendermint 5,653
21 torrent 5,332
22 gaia 5,167
23 dragonboat 4,957

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com