tigerbeetle
viewstamped-replication-made-famous
Our great sponsors
tigerbeetle | viewstamped-replication-made-famous | |
---|---|---|
45 | 2 | |
6,814 | 175 | |
45.1% | 4.0% | |
9.9 | 1.8 | |
5 days ago | almost 2 years ago | |
Zig | Zig | |
Apache License 2.0 | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
tigerbeetle
-
Redis Re-Implemented with SQLite
I'm waiting for someone to implement the Redis API by swapping out the state machine in TigerBeetle (which was built modularly such that the state machine can be swapped out).
- Factor is faster than Zig
-
The Raft Consensus Algorithm
Maelstrom [1], a workbench for learning distributed systems from the creator of Jepsen, includes a simple (model-checked) implementation of Raft and an excellent tutorial on implementing it.
Raft is a simple algorithm, but as others have noted, the original paper includes many correctness details often brushed over in toy implementations. Furthermore, the fallibility of real-world hardware (handling memory/disk corruption and grey failures), the requirements of real-world systems with tight latency SLAs, and a need for things like flexible quorum/dynamic cluster membership make implementing it for production a long and daunting task. The commit history of etcd and hashicorp/raft, likely the two most battle-tested open source implementations of raft that still surface correctness bugs on the regular tell you all you need to know.
The tigerbeetle team talks in detail about the real-world aspects of distributed systems on imperfect hardware/non-abstracted system models, and why they chose viewstamp replication, which predates Paxos but looks more like Raft.
[1]: https://github.com/jepsen-io/maelstrom/
[2]: https://github.com/tigerbeetle/tigerbeetle/blob/main/docs/DE...
- Fastest Branchless Binary Search
-
CWE Top Most Dangerous Software Weaknesses
> There is no reason to use a memory unsafe language anymore, except legacy codebases, and that is also slowly but surely diminishing. I'm still yet to hear this amazingly compelling reason that you just need memory unsafe languages. In terms of cost/benefits analysis, memory unsafety is literally all costs.
Tell that to the authors of new memory unsafe languages (like Zig) and creators of new project in those languages (like https://tigerbeetle.com) :(
- Problems of C, and how Zig addresses them
- File for Divorce from LLVM
-
Zap – fast back ends in Zig
Seeing this, and the use of zig for https://github.com/tigerbeetledb/tigerbeetle I wonder if zig might become a good tradeoff vs rust for servers if in long term it's more readable and maintainable and with a different approach to quality.
I would also be interested to hear the compile time, binary size and memory usage of those example apps.
Looks like the underlying facil.io library hasn't seen any commits since 2021, so that's a bit of a red flag. https://github.com/boazsegev/facil.io
-
Significant examples of Zig software (June 2023)?
About three years ago, we had a thread called "Significant examples of Zig software?". Some time has passed, and there have been fairly large Zig code bases that have surfaced since, such as TigerBeetle (cc /u/eatonphil), or adoption at places like Uber.
viewstamped-replication-made-famous
-
Why you might want a domain-specific database like TigerBeetleDB
...and there's also an open bug bounty so if you think that Zig is not a meaningful improvement over C in terms of safety, it's certainly going to be easy money for you :^)
https://github.com/tigerbeetledb/viewstamped-replication-mad...
What are some alternatives?
LevelDB - LevelDB is a fast key-value storage library written at Google that provides an ordered mapping from string keys to string values.
zig - General-purpose programming language and toolchain for maintaining robust, optimal, and reusable software.
bun - Incredibly fast JavaScript runtime, bundler, test runner, and package manager – all in one
reshade - A generic post-processing injector for games and video software.
rafiki - An open-source, comprehensive Interledger service for wallet providers, enabling them to provide Interledger functionality to their users.
Box2D - Box2D is a 2D physics engine for games
raft - Golang implementation of the Raft consensus protocol
PyOxidizer - A modern Python application packaging and distribution tool
OkHttp - Square’s meticulous HTTP client for the JVM, Android, and GraalVM.
FrameworkBenchmarks - Source for the TechEmpower Framework Benchmarks project
sb_lower_bound - Fastest Branchless Binary Search
raft-grpc-example - Example code for how to get hashicorp/raft running with gRPC