nebari
redb
nebari | redb | |
---|---|---|
11 | 24 | |
259 | 2,914 | |
1.9% | - | |
4.6 | 9.2 | |
7 months ago | 3 days ago | |
Rust | Rust | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
nebari
-
Some key-value storage engines in Rust
Or, you could also look at Nebari, which underlies BonsaiDB https://github.com/khonsulabs/nebari/
-
Are there a demand for management system of embedded storage like RocksDB? I plan to build one in Rust as the language becoming a core of many popular databases but wonder if there’s a demand. Can’t find any similar project even in other languages.
There is Nebari which is the KV part of BonsaiDB I've used both successfully (and that is currently in production)
-
redb 0.4.0: 2x faster commits with 1PC+C instead of 2PC
This looks like it could have been inspired by BonsaiDB's recent problems. I think the authors are now trying to achieve something similar to your project with a new storage layer called Sediment (which will become a part of Nebari if successful).
-
File read performance comparison
I ran my benchmark suite on my 2017 i7 MacBook Pro (Filevault enabled), and I was able to perform a random "get" operation out of a 1 million record dataset in an average of 18us (microseconds).
-
Announcing BonsaiDb v0.2.0: Custom Primary Keys, LZ4 Compression
I haven't spent much time documenting the low-level structures outside of the code itself.
-
Announcing BonsaiDb v0.1.0: A Rust NoSQL database that grows with you
Nebari, the underlying storage layer, also has its own coverage report.
-
Benchmarking relational data in BonsaiDb, a Rust-native NoSQL database
Quite well, but Sled doesn't support the same feature set. I've benchmarked our low-level storage layer against Sled in its own repostiory: Nebari Benchmark README. There are two links two criterion reports on that page.
-
Are there any big projects written in Rust without any use of unsafe code?
I maintain several large codebases that have #![forbid(unsafe)] annotations, which prevent unsafe code from being written in those codebases directly. BonsaiDb clocks in at just shy of 30k LOC, and depends on Nebari which is another 12k LOC. Those two crates make up the bulk of a networked database implementation.
-
What is the best key-value store for Rust 2021
I have, and there's a set of microbenchmarks in the repository. There are two links to reports on that page -- one that's executed on GitHub Actions, which can have quite widely varying performance, and one that's executed on a "dedicated" VPS instance from Scaleway -- exact specs are on that page. I've kicked off another run on that VPS, since it hasn't been run since October. It takes a while to run, so if it still says October, try hitting refresh a little later.
-
What's everyone working on this week (40/2021)?
I replaced Sled in BonsaiDb with a new storage layer I wrote: Nebari. I just wrote a post this morning recalling my struggles over the last month to feel comfortable sharing this project outside of a smaller group of people.
redb
-
Are You Sure You Want to Use MMAP in Your DBMS?
I wrote redb (https://github.com/cberner/redb) using mmap, initially. However, I later removed it and switched to read()/write() with my own user space cache. I'm sure it's not as good as the OS page cache, but the difference was only 1.2-1.5x performance on the benchmarks I cared about, and the cache is less than 500 lines of code.
-
struct_db 0.4.0
exposure of the redb builder functionalities.
-
redb (safe, ACID, embedded, key-value store) 1.0 release!
redb has reached its 1.0 release. The file format is now gauranteed to be backward compatible, and the API is stable. I've run pretty extensive fuzz testing, but please report any bugs you encounter.
-
RFC: redb (embedded key-value store) nearing version 1.0
I'm just now updating the benchmarks in the readme with multi-threaded workloads :) https://github.com/cberner/redb/pull/576
-
Best local database that works on all platforms including web?
redb, but that doesn't have a stable file format yet,
-
What do you recommend for conflict-free replicated data type (CRDT) support in Rust?
I also have to support web, so I'm considering a hybrid approach with a direct IndexedDB API there and something like sqlite, percy, sanakirja, or redb on native.
-
Some key-value storage engines in Rust
Nice list, but don’t forget persy, redb and sanakirja too!
-
Are there a demand for management system of embedded storage like RocksDB? I plan to build one in Rust as the language becoming a core of many popular databases but wonder if there’s a demand. Can’t find any similar project even in other languages.
check out https://github.com/cberner/redb! it is inspired by LMDB and has comparable performance, but is entirely built in rust!
-
Meilisearch just announced its $15M Serie A, the search Rust engine strikes again
Yup, the language is immature in some domains like data replication, compilation time, lifetime expressivity, not having a default async runtime and the incompatibility of all of them. But many of these domains are worked on and improved every day this is why I love this language so much. This is because there is space for improvement. I also hope that one day we will have a pure-Rust LMDB alternative that I can contribute to without fear of C.
-
RFC+AMA: redb, embedded key-value store file format
they are, ya! I'm quite excited about that, and already have a PR open to use GATs. It's not enough to fix this issue though, because std needs to add support for LendingIterator too
What are some alternatives?
glow - GL on Whatever: a set of bindings to run GL anywhere and avoid target-specific code
sled - the champagne of beta embedded databases
forbidden - An auth system/library for Rust applications
heed - A fully typed LMDB wrapper with minimum overhead 🐦
ab-av1 - AV1 re-encoding using ffmpeg, svt-av1 & vmaf.
engula - Engula is a distributed key-value store, used as a cache, database, and storage engine.
tokio-uring - An io_uring backed runtime for Rust
PickleDB - PickleDB-rs is a lightweight and simple key-value store. It is a Rust version for Python's PickleDB
rust - Empowering everyone to build reliable and efficient software.
bonsaidb - A developer-friendly document database that grows with you, written in Rust
sediment - A low-level MVCC file format for storing blobs.