Rust Distributed Systems

Open-source Rust projects categorized as Distributed Systems

Top 23 Rust Distributed System Projects

  • talent-plan

    open source training courses about distributed database and distributed systems

    Project mention: Need insights to build a distributed key value store from scratch. | /r/DistributedComputing | 2023-12-08

    Pls check this course: https://github.com/pingcap/talent-plan . It includes how to implement sql and key value store. It’s an awesome course

  • materialize

    The data warehouse for operational workloads. (by MaterializeInc)

    Project mention: Choosing Between a Streaming Database and a Stream Processing Framework in Python | dev.to | 2024-02-10

    To fully leverage the data is the new oil concept, companies require a special database designed to manage vast amounts of data instantly. This need has led to different database forms, including NoSQL databases, vector databases, time-series databases, graph databases, in-memory databases, and in-memory data grids. Recent years have seen the rise of cloud-based streaming databases such as RisingWave, Materialize, DeltaStream, and TimePlus. While they each have distinct commercial and technical approaches, their overarching goal remains consistent: to offer users cloud-based streaming database services.

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  • Ockam

    Orchestrate end-to-end encryption, cryptographic identities, mutual authentication, and authorization policies between distributed applications – at massive scale.

    Project mention: How we built a Swift app that uses Rust | dev.to | 2023-12-28

    🚀 Portals for Mac – A macOS app built in Swift that uses the Ockam Rust library to privately share a service on your Mac with anyone, anywhere. The service is shared securely over an end-to-end encrypted and mutually authenticated Ockam Portal. Your friends will have access to it on their localhost! This app is a great example of the kinds of things you can build with Ockam 👉

  • rustpad

    Efficient and minimal collaborative code editor, self-hosted, no database required

  • reth

    Modular, contributor-friendly and blazing-fast implementation of the Ethereum protocol, in Rust

    Project mention: Spin up a private network with Reth using Kurtosis! | /r/ethereum | 2023-08-27

    Reth is Paradigm's new modular and blazing-fast implementation of Ethereum. The Reth team has already been using Kurtosis to spin up interop devnets and find bugs (source and bug fix).

  • raft-rs

    Raft distributed consensus algorithm implemented in Rust.

  • bastion

    Highly-available Distributed Fault-tolerant Runtime

    Project mention: Write Elixir NIFs in Rust | news.ycombinator.com | 2023-08-06
  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  • habitat

    Modern applications with built-in automation

  • aurae

    Distributed systems runtime daemon written in Rust.

    Project mention: Kris Nova Passed Away | news.ycombinator.com | 2023-08-20

    Her recent project - https://github.com/aurae-runtime/aurae

  • stateright

    A model checker for implementing distributed systems.

  • rust-rdkafka

    A fully asynchronous, futures-based Kafka client library for Rust based on librdkafka

    Project mention: Rust Cpp Interop via Cxx, Autocxx / any best practices out there | /r/rust | 2023-06-19

    I use this library a lot and it's got some nice touches for how to handle wrapping a C library: https://github.com/fede1024/rust-rdkafka

  • rust-crdt

    a collection of well-tested, serializable CRDTs for Rust

  • zenoh

    zenoh unifies data in motion, data in-use, data at rest and computations. It carefully blends traditional pub/sub with geo-distributed storages, queries and computations, while retaining a level of time and space efficiency that is well beyond any of the mainstream stacks.

    Project mention: Eclipse Zenoh 0.10.0 is out | /r/rust | 2023-10-04
  • openraft

    rust raft with improvements

  • Coerce-rs

    Actor runtime and distributed systems framework for Rust

  • delicate

    A lightweight and distributed task scheduling platform written in rust. (一个轻量的分布式的任务调度平台通过rust编写)

  • nanocl

    Distributed System that simplifies the management of containers and virtual machines.

    Project mention: What are you rewriting in rust? | /r/rust | 2023-07-10

    Kubernetes (sorta) https://github.com/nxthat/nanocl It's still in early stages rn but always looking for more contributors!

  • corrosion

    Gossip-based service discovery (and more) for large distributed systems. (by superfly)

    Project mention: Local-first software: You own your data, in spite of the cloud (2019) | news.ycombinator.com | 2023-10-02

    Couchdb/pouchdb remains one of the best: it's super easy to setup and is production-ready, but it's gonna be json docs with no transactions, so it can be limiting.

    Y.js and automerge emerged as solutions combining CRDTs and content transfer, they look really promising. There is a Y.rs version if that's better for you.

    I've always dreamt of building something on top of Syncthing, ie something that would use file synchronization. It's more versatile and will definitely last longer than anything else, and it has some built-in capabilities for having a third party helping transport but not being allowed to read content.

    I recently came across https://github.com/superfly/corrosion , a service discovery and state management tool that is working completely p2p. CR-SQLite, in particular, allows multiple tables from multiple databases to be merged thanks to CRDTs. I'm sure there's a lot to build on top of it.

    I feel like you're not really interested in full p2p but want some centralization point to manage some auth stuff, so I'd investigate couchdb/pouchdb first.

  • madsim

    Magical Deterministic Simulator for distributed systems in Rust.

    Project mention: Is Something Bugging You? | news.ycombinator.com | 2024-02-13
  • Ruma

    A set of Rust crates for interacting with the Matrix chat network.

  • Xline

    A geo-distributed KV store for metadata management

    Project mention: Multi-region multi-cloud cluster. Best practices? | /r/kubernetes | 2023-12-08
  • dbeel

    A distributed thread-per-core document database

    Project mention: Building an open source vector database. Looking for advice. | /r/rust | 2023-12-07

    If you want some code examples, I wrote a db in rust that might help you: https://github.com/tontinton/dbeel

  • little-raft

    The lightest distributed consensus library. Run your own replicated state machine! ❤️

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2024-02-13.

Rust Distributed Systems related posts

Index

What are some of the best open-source Distributed System projects in Rust? This list will help you:

Project Stars
1 talent-plan 9,706
2 materialize 5,510
3 Ockam 4,293
4 rustpad 3,006
5 reth 2,885
6 raft-rs 2,748
7 bastion 2,729
8 habitat 2,551
9 aurae 1,811
10 stateright 1,488
11 rust-rdkafka 1,430
12 rust-crdt 1,262
13 zenoh 1,172
14 openraft 1,102
15 Coerce-rs 647
16 delicate 627
17 nanocl 565
18 corrosion 564
19 madsim 561
20 Ruma 543
21 Xline 482
22 dbeel 441
23 little-raft 404
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com