SaaSHub helps you find the best software and product alternatives Learn more →
Top 23 Key Value Store Open-Source Projects
-
-
valkey
A new project to resume development on the formerly open-source Redis project. We're calling it Valkey, since it's a twist on the key-value datastore.
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
-
Olric
Distributed in-memory object store. It can be used as an embedded Go library and a language-independent service.
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
skytable
Skytable is a modern scalable NoSQL database with BlueQL, designed for performance, scalability and flexibility. Skytable gives you spaces, models, data types, complex collections and more to build powerful experiences
-
DiskCache
Python disk-backed cache (Django-compatible). Faster than Redis and Memcached. Pure-Python.
-
incubator-pegasus
Apache Pegasus - A horizontally scalable, strongly consistent and high-performance key-value store
-
redix
a very simple pure key => value storage system that speaks Redis protocol with Postgres as storage engine and more
-
Infinispan
Infinispan is an open source data grid platform and highly scalable NoSQL cloud data store.
-
-
cachegrand
cachegrand - a modern data ingestion, processing and serving platform built for today's hardware
-
-
-
gokv
Simple key-value store abstraction and implementations for Go (Redis, Consul, etcd, bbolt, BadgerDB, LevelDB, Memcached, DynamoDB, S3, PostgreSQL, MongoDB, CockroachDB and many more)
-
Prephirences
Prephirences is a Swift library that provides useful protocols and convenience methods to manage application preferences, configurations and app-state. UserDefaults
-
ustore
Multi-Modal Database replacing MongoDB, Neo4J, and Elastic with 1 faster ACID solution, with NetworkX and Pandas interfaces, and bindings for C 99, C++ 17, Python 3, Java, GoLang 🗄️
-
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
Actually, Apple does this for iCloud! They use FoundationDB[1] to store billions of databases, one for each user (plus shared or global databases).
See: https://read.engineerscodex.com/p/how-apple-built-icloud-to-...
Discussed on HN at the time: https://news.ycombinator.com/item?id=39028672
[1]: https://github.com/apple/foundationdb https://en.wikipedia.org/wiki/FoundationDB
Changelog line items is probably a better measure (assuming the line items are aligned to features and bugfixes and not just a list of PRs) https://github.com/valkey-io/valkey/releases
Maybe version number/release cadence is also helpful.
Project mention: A MySQL compatible database engine written in pure Go | news.ycombinator.com | 2024-04-09You would be surprised by performance of modern .NET :)
Writing no-alloc is oftentimes done by reducing complexity and not doing "stupid" tricks that actually work against JIT and CoreLib features.
For databases specifically, .NET is actually positioned very well with its low-level features (intrisics incl. SIMD, FFI, struct generics though not entirely low-level) and high-throughput GC.
Interesting example of this applied in practice is Garnet[0]/FASTER[1]. Keep in mind that its codebase still consist of un-idiomatic C# and you can do way better by further simplification, but it already does the job well enough.
[0] https://github.com/microsoft/garnet
[1] https://github.com/microsoft/FASTER
The 3rd party library I use GRDB SwiftyUserDefaults Kingfisher SwiftDate Popovers
Project mention: Olric: Distributed, embeddable in-memory data structures in Go | news.ycombinator.com | 2024-02-05
Project mention: Show HN: Skytable's new NoSQL engine BlueQL with injection safety, improved perf | news.ycombinator.com | 2023-12-10Hey HN!
I've been working on Skytable since 2020 and after several iterations from a simple K/V store, we've walked the path to this release. The goal of Skytable is to deliver a solid foundation for building data intensive applications.
Skytable's primary goal is performance and scale. Even with a query language it can outperform K/V stores which use simple commands (benchmarks will be shared in another post).
Several implementations in Skytable (especially around query evaluation and execution) are fundamentally different from SQL and even NoSQL counterparts and there are some entirely new concepts which might make it a little hard to grasp.
BlueQL is a very important part of Skytable and it employs some interesting concepts to try and reduce the surface for injection attacks and tries to be a modern and secure alternative to SQL.
- Source code: https://github.com/skytable/skytable
python-diskcache – disk-backed cache (Django-compatible). Faster than Redis and Memcached. Pure-Python
Project mention: Sparkey is a simple constant key/value storage library | news.ycombinator.com | 2024-01-04
Project mention: Datalevin: A simple, fast and versatile Datalog database | news.ycombinator.com | 2024-02-01
Project mention: Please add licenses to your projects, rust DS emulator Dust now dead. | /r/rust | 2023-06-28
Really great overview!
I've been tracking some of them for a while as part of evaluating which ones to add to my key-value abstraction library gokv [1], but others only noticed recently. It's really interesting that there's no single most popular implementation, but new ones emerging and gaining popularity regularly.
[1] https://github.com/philippgille/gokv
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
Key Value Store related posts
- SwiftPaxos: Fast Geo-Replicated State Machines
- SwiftPaxos: Fast Geo-Replicated State Machines
- SwiftPaxos: Fast Geo-Replicated State Machines
- Redis Is Forked
- New Redis Inc logo and branding [video]
- Redis' license change and forking are a mess that everybody can feel bad about
- Valkey – a new project to resume development on the formerly open-source Redis
-
A note from our sponsor - SaaSHub
www.saashub.com | 25 Apr 2024
Index
What are some of the best open-source Key Value Store projects? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | foundationdb | 13,971 |
| 2 | valkey | 12,754 |
| 3 | FASTER | 6,199 |
| 4 | SwiftyUserDefaults | 4,818 |
| 5 | hawk | 3,966 |
| 6 | ImmortalDB | 3,046 |
| 7 | Olric | 3,005 |
| 8 | skytable | 2,249 |
| 9 | DiskCache | 2,157 |
| 10 | incubator-pegasus | 1,944 |
| 11 | pogreb | 1,221 |
| 12 | redix | 1,196 |
| 13 | Infinispan | 1,124 |
| 14 | datalevin | 1,030 |
| 15 | cachegrand | 963 |
| 16 | Zephyr | 916 |
| 17 | speedb | 822 |
| 18 | hse | 672 |
| 19 | gokv | 666 |
| 20 | Prephirences | 568 |
| 21 | cubdb | 512 |
| 22 | ustore | 486 |
| 23 | lmdb-js | 454 |
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com