Go distributed-database

Open-source Go projects categorized as distributed-database

Top 10 Go distributed-database Projects

  • etcd

    Distributed reliable key-value store for the most critical data of a distributed system

  • Project mention: Is Kubernetes a database? CRDs explained in five minutes | dev.to | 2024-05-24

    Each time we create or update a K8s resource, the Kubernetes API stores it in its database — etcd. etcd is a distributed key-value store used to store all of your resource configurations, such as deployments, services, and so on. A neat feature of etcd is that you can subscribe to changes in some keys in the database, which is used by other Kubernetes mechanisms.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • tidb

    TiDB is an open-source, cloud-native, distributed, MySQL-Compatible database for elastic scale and real-time analytics. Try AI-powered Chat2Query free at : https://www.pingcap.com/tidb-serverless/

  • Project mention: A MySQL compatible database engine written in pure Go | news.ycombinator.com | 2024-04-09

    tidb has been around for a while, it is distributed, written in Go and Rust, and MySQL compatible. https://github.com/pingcap/tidb

    Somewhat relatedly, StarRocks is also MySQL compatible, written in Java and C++, but it's tackling OLAP use-cases. https://github.com/StarRocks/starrocks

  • cockroach

    CockroachDB - the open source, cloud-native distributed SQL database.

  • Project mention: Show HN: Restate, low-latency durable workflows for JavaScript/Java, in Rust | news.ycombinator.com | 2024-06-12

    Restate is built as a sharded replicated state machine similar to how TiKV (https://tikv.org/), Kudu (https://kudu.apache.org/kudu.pdf) or CockroachDB (https://github.com/cockroachdb/cockroach) are designed. Instead of relying on a specific consensus implementation, we have decided to encapsulate this part into a virtual log (inspired by Delos https://www.usenix.org/system/files/osdi20-balakrishnan.pdf) since it makes it possible to tune the system more easily for different deployment scenarios (on-prem, cloud, cost-effective blob storage). Moreover, it allows for some other cool things like seamlessly moving from one log implementation to another. Apart from that the whole system design has been influenced by ideas from stream processing systems such as Apache Flink (https://flink.apache.org/), log storage systems such as LogDevice (https://logdevice.io/) and others.

    We plan to publish a more detailed follow-up blog post where we explain why we developed a new stateful system, how we implemented it, and what the benefits are. Stay tuned!

  • rqlite

    The lightweight, distributed relational database built on SQLite.

  • Project mention: Why SQLite Is Taking over with Brian Holt and Marco Bambini | news.ycombinator.com | 2024-06-12

    SQLite is not competing with RDMBSes. SQLite is competing with fopen().

    There are of course solutions which wrap this fopen() replacement in a network/cluster-aware tools, e.g. https://github.com/rqlite/rqlite - these are competing with postgres.

  • Olric

    Distributed in-memory object store. It can be used as an embedded Go library and a language-independent service.

  • Project mention: Olric: Distributed, embeddable in-memory data structures in Go | news.ycombinator.com | 2024-02-05
  • lindb

    LinDB is a scalable, high performance, high availability distributed time series database.

  • matrixone

    Hyperconverged cloud-edge native database

  • Project mention: Push or Pull, is this a question? | dev.to | 2023-08-09

    Source code:matrixorigin/matrixone: Hyperconverged cloud-edge native database (github.com)

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  • IceFireDB

    @IceFireLabs -> IceFireDB is a database built for web3.0 It strives to fill the gap between web2 and web3.0 with a friendly database experience, making web3 application data storage more convenient, and making it easier for web2 applications to achieve decentralization and data immutability.

  • etcd-cloud-operator

    Deploying and managing production-grade etcd clusters on cloud providers: failure recovery, disaster recovery, backups and resizing.

  • shardingsphere-on-cloud

    A collection of tools and best practices to take ShardingSphere into the cloud

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Go distributed-database discussion

Log in or Post with

Go distributed-database related posts

  • Multi-region YugabyteDB deployment on AWS EKS with Istio

    3 projects | dev.to | 2 May 2024
  • A MySQL compatible database engine written in pure Go

    10 projects | news.ycombinator.com | 9 Apr 2024
  • Show HN: GitHub Organization Analytics

    1 project | news.ycombinator.com | 25 Oct 2023
  • Hummock: A Storage Engine Designed for Stream Processing

    2 projects | dev.to | 17 Oct 2023
  • TiDB: An open-source distributed MySQL compatible database

    1 project | news.ycombinator.com | 17 Oct 2023
  • TiDB: Open-source, cloud-native, distributed, MySQL compatible database

    1 project | news.ycombinator.com | 30 Aug 2023
  • Linux surpasses the Mac among Steam gamers

    2 projects | news.ycombinator.com | 4 Aug 2023
  • A note from our sponsor - InfluxDB
    www.influxdata.com | 22 Jun 2024
    Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →


What are some of the best open-source distributed-database projects in Go? This list will help you:

Project Stars
1 etcd 46,693
2 tidb 36,427
3 cockroach 29,425
4 rqlite 15,131
5 Olric 3,032
6 lindb 2,849
7 matrixone 1,696
8 IceFireDB 1,088
9 etcd-cloud-operator 234
10 shardingsphere-on-cloud 82

Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.