db
memmap-rs
db | memmap-rs | |
---|---|---|
1 | 3 | |
173 | 519 | |
0.0% | - | |
0.0 | 0.0 | |
almost 2 years ago | about 2 years ago | |
Java | Rust | |
GNU Affero General Public License v3.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
db
-
Freqfs: In-memory filesystem cache for Rust
We actually did work on this a few years ago but did not get enough takers for it. We created a one size fits all database, that leverages the full capability of the file system.
Try it here: https://github.com/blobcity/db
PS: I am the chief architect of the DB, and the project is no longer being actively maintained by us. But if you make a contribution, we will oblige to review and merge a PR.
Bottom line, nothing you do can make your database faster than the filesystem. So why not make a database that just uses the filesystem to the fullest, than creating a filesystem on top of a filesystem. BlobCity DB does not create a secondary filesystem. It dumps all data directly to the filesystem, thereby giving peak filesystem performance. This is scientifically really the best it gets from a performance standpoint. Not necessarily the most efficient in data storage / data-compression standpoint.
This means, we gain speed, while compromising on data-compression. We produce a larger storage footprint, but are insanely fast. Storage is cheap, compute isn't. So that should be okay I suppose.
memmap-rs
- Freqfs: In-memory filesystem cache for Rust
-
How to properly replacing in huge file?
You could try using memmap
-
Building an OpenStreetMap app in Rust, Part IV
Turns out OSMPBF is a no-go for me, as the memmap dependency doesn't compile for WebAssembly...
What are some alternatives?
freqfs - An in-memory filesystem cache layer based on tokio::fs, with least-frequently-used eviction
nom - Rust parser combinator framework
openEtG
osmpbf - A Rust library for reading the OpenStreetMap PBF file format (*.osm.pbf).