sled
nebari
Our great sponsors
sled | nebari | |
---|---|---|
37 | 11 | |
7,736 | 259 | |
- | 3.1% | |
2.4 | 4.6 | |
5 days ago | 6 months ago | |
Rust | Rust | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
sled
-
SableDb – a key/value store that uses RocksDB and Redis API (written in Rust)
a few times, seems interesting. The author's also built a lot of other cool concurrency primitives for Rust as well.
-
Is Something Bugging You?
- Dropbox [3] uses a similar approach but they talk about it a bit more abstractly.
Sans-IO is more documented in Python [4], but str0m [5] and quinn-proto [6] are the best examples in Rust I’m aware of. Note that sans-IO is orthogonal to deterministic test frameworks, but it composes well with them.
With the disclaimer that my opinions are mine and mine alone, and don’t reflect the company I work at —— I do work at a rust shop that has utilized these techniques on some projects.
TigerBeetle is an amazing example and I’ve looked at it before! They are really the best example of this approach outside of FoundationDB I think.
[0]: https://risingwave.com/blog/deterministic-simulation-a-new-e...
[1]: https://risingwave.com/blog/applying-deterministic-simulatio...
[2]: https://dropbox.tech/infrastructure/-testing-our-new-sync-en...
[3]: https://github.com/spacejam/sled
[4]: https://fractalideas.com/blog/sans-io-when-rubber-meets-road...
[5]: https://github.com/algesten/str0m
[6]: https://docs.rs/quinn-proto/0.10.6/quinn_proto/struct.Connec...
-
RFC: redb (embedded key-value store) nearing version 1.0
Sled uses bw-tree actually https://github.com/spacejam/sled/wiki/sled-architectural-outlook
-
Production grade databases in Rust
There is a valid argument to be made for threads over async in a large percentage of use cases where async is considered the default. If this is what you are referring to however, I don't think they ever referred to async as completely useless: https://github.com/spacejam/sled/issues/1123.
-
Best local database that works on all platforms including web?
Have you looked into other pure-Rust databases as well, such as sled or GlueSQL which has an SQL interface on top of sled? I wonder how those would compare to Persy.
-
Are there any embedded databases that have multiple-process support?
I'm not sure what you need. Are these of any use? https://github.com/meilisearch/heed https://github.com/spacejam/sled
- Some key-value storage engines in Rust
-
Are there a demand for management system of embedded storage like RocksDB? I plan to build one in Rust as the language becoming a core of many popular databases but wonder if there’s a demand. Can’t find any similar project even in other languages.
There is also Sled but as I understand it that is being reworked to use the author's new DB core Marble
-
GreptimeDB: a new open source database designed for large-scale time-series data storage and processing, written in rust
There are some databases like sled/FlashDB designed to be embedded to other applications even bare metal microcontrollers. But I do doubt the potential bussiness value of a pure embedded database.
-
Ask HN: Serverless” key value store with transactions?
https://github.com/spacejam/sled
To add transaction support, you probably need a good understanding of how the memtable works in Log Structured Merge trees:
nebari
-
Some key-value storage engines in Rust
Or, you could also look at Nebari, which underlies BonsaiDB https://github.com/khonsulabs/nebari/
-
Are there a demand for management system of embedded storage like RocksDB? I plan to build one in Rust as the language becoming a core of many popular databases but wonder if there’s a demand. Can’t find any similar project even in other languages.
There is Nebari which is the KV part of BonsaiDB I've used both successfully (and that is currently in production)
-
redb 0.4.0: 2x faster commits with 1PC+C instead of 2PC
This looks like it could have been inspired by BonsaiDB's recent problems. I think the authors are now trying to achieve something similar to your project with a new storage layer called Sediment (which will become a part of Nebari if successful).
-
File read performance comparison
I ran my benchmark suite on my 2017 i7 MacBook Pro (Filevault enabled), and I was able to perform a random "get" operation out of a 1 million record dataset in an average of 18us (microseconds).
-
Announcing BonsaiDb v0.2.0: Custom Primary Keys, LZ4 Compression
I haven't spent much time documenting the low-level structures outside of the code itself.
-
Announcing BonsaiDb v0.1.0: A Rust NoSQL database that grows with you
Nebari, the underlying storage layer, also has its own coverage report.
-
Benchmarking relational data in BonsaiDb, a Rust-native NoSQL database
Quite well, but Sled doesn't support the same feature set. I've benchmarked our low-level storage layer against Sled in its own repostiory: Nebari Benchmark README. There are two links two criterion reports on that page.
-
Are there any big projects written in Rust without any use of unsafe code?
I maintain several large codebases that have #![forbid(unsafe)] annotations, which prevent unsafe code from being written in those codebases directly. BonsaiDb clocks in at just shy of 30k LOC, and depends on Nebari which is another 12k LOC. Those two crates make up the bulk of a networked database implementation.
-
What is the best key-value store for Rust 2021
I have, and there's a set of microbenchmarks in the repository. There are two links to reports on that page -- one that's executed on GitHub Actions, which can have quite widely varying performance, and one that's executed on a "dedicated" VPS instance from Scaleway -- exact specs are on that page. I've kicked off another run on that VPS, since it hasn't been run since October. It takes a while to run, so if it still says October, try hitting refresh a little later.
-
What's everyone working on this week (40/2021)?
I replaced Sled in BonsaiDb with a new storage layer I wrote: Nebari. I just wrote a post this morning recalling my struggles over the last month to feel comfortable sharing this project outside of a smaller group of people.
What are some alternatives?
RocksDB - A library that provides an embeddable, persistent key-value store for fast storage.
glow - GL on Whatever: a set of bindings to run GL anywhere and avoid target-specific code
rust-rocksdb - rust wrapper for rocksdb
forbidden - An auth system/library for Rust applications
sqlx - 🧰 The Rust SQL Toolkit. An async, pure Rust SQL crate featuring compile-time checked queries without a DSL. Supports PostgreSQL, MySQL, and SQLite.
redb - An embedded key-value database in pure Rust
redis-rs - Redis library for rust
engula - Engula is a distributed key-value store, used as a cache, database, and storage engine.
mini-redis - Incomplete Redis client and server implementation using Tokio - for learning purposes only
PickleDB - PickleDB-rs is a lightweight and simple key-value store. It is a Rust version for Python's PickleDB
heed - A fully typed LMDB wrapper with minimum overhead 🐦
bonsaidb - A developer-friendly document database that grows with you, written in Rust