Implementing a distributed key-value store on top of implementing Raft in Go

• etcd

  61 46,345 9.9 Go

  Distributed reliable key-value store for the most critical data of a distributed system

  

• automat

  2 550 1.8 Python

  Self-service finite-state machines for the programmer on the go.

Sounds like a job for state machines like you can build out with a library like xstate[0] (though I'm sure there are similar libraries in whatever language you choose. Python has one called automat[1])

These exist to formalize state logic, you can even produce diagrams based on their definitions

[0]: https://stately.ai/docs/xstate

[1]: https://github.com/glyph/Automat

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• coyote

  13 1,417 6.0 C#

  Coyote is a library and tool for testing concurrent C# code and deterministically reproducing bugs.

  

Microsoft has a library/tool called Coyote* that helps with testing distributed systems; you can write tests/specifications, Coyote will systematically explore nondeterminism in your system and check if your tests still pass. If there's a failure, it'll show the sequence of events that led to the failing test.

I started a project to implement Raft with a KV-store on top, similar to the article, meaning to use Coyote to test it; I didn't get that far before losing interest, though. It's reassuring to read that it took Phil several months to write the code in the post, it's good to know that this is a decidedly nontrivial problem.

* https://github.com/microsoft/coyote

• tikv

  21 14,512 9.7 Rust

  Distributed transactional key-value database, originally created to complement TiDB

  

• raft

  7 7,845 6.0 Go

  Golang implementation of the Raft consensus protocol

  

I have found the performance tests very tricky to get to pass without having any input from others. The assignment is really very unforgiving, I would wager the test suite is comparable to how commercial Raft implementations are tested (e.g. https://github.com/hashicorp/raft)

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

Suggest a related project