maelstrom
talent-plan
maelstrom | talent-plan | |
---|---|---|
14 | 23 | |
2,792 | 9,813 | |
2.0% | 0.4% | |
5.1 | 0.0 | |
24 days ago | 8 months ago | |
Clojure | Rust | |
Eclipse Public License 1.0 | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
maelstrom
- Maelstrom: A workbench for learning distributed systems
-
The Raft Consensus Algorithm
Maelstrom [1], a workbench for learning distributed systems from the creator of Jepsen, includes a simple (model-checked) implementation of Raft and an excellent tutorial on implementing it.
Raft is a simple algorithm, but as others have noted, the original paper includes many correctness details often brushed over in toy implementations. Furthermore, the fallibility of real-world hardware (handling memory/disk corruption and grey failures), the requirements of real-world systems with tight latency SLAs, and a need for things like flexible quorum/dynamic cluster membership make implementing it for production a long and daunting task. The commit history of etcd and hashicorp/raft, likely the two most battle-tested open source implementations of raft that still surface correctness bugs on the regular tell you all you need to know.
The tigerbeetle team talks in detail about the real-world aspects of distributed systems on imperfect hardware/non-abstracted system models, and why they chose viewstamp replication, which predates Paxos but looks more like Raft.
[1]: https://github.com/jepsen-io/maelstrom/
[2]: https://github.com/tigerbeetle/tigerbeetle/blob/main/docs/DE...
-
zio-maelstrom
I've tried to run the echo example and I'me getting some problems. I assume it works as the same example in the maelstrom's getting started ready (https://github.com/jepsen-io/maelstrom/blob/main/doc/01-getting-ready/index.md).
- Ask HN: Projects to do to get better at distributed systems
- Resources about distributed systems in go
- FLiPN-FLaNK Stack for March 6, 2023
-
Gossip Glomers: Fly.io Distributed Systems Challenges
Love it. Thanks for putting this together! The actual challenges here [0].
Though I'm curious: are these different from the chapters in the Maelstrom documentation [1]? There seems to be a bit of overlap anyway.
[0] https://fly.io/dist-sys/
[1] https://github.com/jepsen-io/maelstrom#documentation
talent-plan
-
Need insights to build a distributed key value store from scratch.
Pls check this course: https://github.com/pingcap/talent-plan . It includes how to implement sql and key value store. It’s an awesome course
-
Ask HN: Leetcode for Back End and Server Development
- https://hackattic.com/ : Interesting programming Problems.
- https://sadservers.com/ : Learn Linux by solving problems.
- https://fly.io/dist-sys/ : Distributed Systems Problems.
- https://github.com/pingcap/talent-plan/ : System Programming / Distributed System Challenge.
- https://protohackers.com/ : Server Programming Challenges.
- https://codecrafters.io/ : Implement server tech / softwares from scratch.
- https://hyperskill.org/ : Lots of projects based tutorials.
- https://github.com/pingcap/talent-plan/ : System Programming / Distributed System Challenge.
- new Rust Networking book
-
Gossip Glomers: Fly.io Distributed Systems Challenges
Awesome stuff!
Just to share in the way: open source training courses about distributed database and distributed systems by PingCap.
https://github.com/pingcap/talent-plan
- Learning and Building a KV Database in rust.
-
How does serde_json work?
You should try this lab by PingCAP (write a serde implementation for redis serialization protocol) ; you can find answers/seek help in github if you really don't know to figure out it.
-
Hey Rustaceans! Got a question? Ask here! (20/2022)!
I am doing pingcap's talent plan recently, where you need to implement a custom Deserializer for REdis Serialization Protocol for the building block 3. What confuses me most is the implementation of `EnumAccess` and `VariantAccess`. One of my attempt looks like the following:
-
Love
Looking at your project, I would recommend following this tutorial that makes you write key-value store in Rust. They don't provide you with a solution and make you come up with most stuff yourself, but give you some direction and structure for learning. You seem to have come up with most of this yourself already, but it might still be useful for you.
-
Newbie here. Just finished reading the book. What now?
If you are interested in network programming and distributed system, checkout https://github.com/pingcap/talent-plan
What are some alternatives?
nosqlbench - The open source, pluggable, nosql benchmarking suite.
dnsguide - A guide to writing a DNS Server from scratch in Rust
kaocha - Full featured next gen Clojure test runner
duckdb - DuckDB is an in-process SQL OLAP Database Management System
titanoboa - Titanoboa makes complex workflows easy. It is a low-code workflow orchestration platform for JVM - distributed, highly scalable and fault tolerant.
toydb - Distributed SQL database in Rust, written as a learning project
bond - spying for tests
rust-plus-golang - Rust + Go — Call Rust code from Go using FFI
openai-python - The official Python library for the OpenAI API
mini-redis - Incomplete Redis client and server implementation using Tokio - for learning purposes only
unilm - Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
duckdb-rs - Ergonomic bindings to duckdb for Rust