Ask HN: Why are there no open source NVMe-native key value stores in 2023?

1. KVRocks

   1 2 46 10.0 C++

   RocksDB compatible key value store and MyRocks compatible storage engine designed for KV SSD (by OpenMPDK)

   

2. InfluxDB

   www.influxdata.com featured

   InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.

   

3. ScaleStore

   2 3 122 3.5 C++

   This is the source code for our (Tobias Ziegler, Carsten Binnig and Viktor Leis) published paper at SIGMOD’22: ScaleStore: A Fast and Cost-Efficient Storage Engine using DRAM, NVMe, and RDMA.

   

   I don't remember exactly why I have any of them saved, but these are some experimental data stores that seems to be fitting what you're looking for somewhat:

   - https://github.com/DataManagementLab/ScaleStore - "A Fast and Cost-Efficient Storage Engine using DRAM, NVMe, and RDMA"

   - https://github.com/unum-cloud/udisk - "The fastest ACID-transactional persisted Key-Value store designed for NVMe block-devices with GPU-acceleration and SPDK to bypass the Linux kernel."

   - https://github.com/capsuleman/ssd-nvme-database - "Columnar database on SSD NVMe"

4. udisk

   3 1 69 1.8

   The fastest ACID-transactional persisted Key-Value store designed as modified LSM-Tree for NVMe block-devices with GPU-acceleration and SPDK to bypass the Linux kernel

   

   I don't remember exactly why I have any of them saved, but these are some experimental data stores that seems to be fitting what you're looking for somewhat:

   - https://github.com/DataManagementLab/ScaleStore - "A Fast and Cost-Efficient Storage Engine using DRAM, NVMe, and RDMA"

   - https://github.com/unum-cloud/udisk - "The fastest ACID-transactional persisted Key-Value store designed for NVMe block-devices with GPU-acceleration and SPDK to bypass the Linux kernel."

   - https://github.com/capsuleman/ssd-nvme-database - "Columnar database on SSD NVMe"

5. ssd-nvme-database

   4 1 13 10.0 C++

   Columnar database on SSD NVMe

   

   I don't remember exactly why I have any of them saved, but these are some experimental data stores that seems to be fitting what you're looking for somewhat:

   - https://github.com/DataManagementLab/ScaleStore - "A Fast and Cost-Efficient Storage Engine using DRAM, NVMe, and RDMA"

   - https://github.com/unum-cloud/udisk - "The fastest ACID-transactional persisted Key-Value store designed for NVMe block-devices with GPU-acceleration and SPDK to bypass the Linux kernel."

   - https://github.com/capsuleman/ssd-nvme-database - "Columnar database on SSD NVMe"

6. solid_cache

   5 7 940 8.3 Ruby

   A database-backed ActiveSupport::Cache::Store

   

   Is that discussion/implementation of nvme available somewhere in public?

   https://github.com/rails/solid_cache didn't include anything about NVME that I could find.

7. kvrocks

   6 28 3,862 9.6 C++

   Apache Kvrocks is a distributed key value NoSQL database that uses RocksDB as storage engine and is compatible with Redis protocol.

   

   There’s Kvrocks. It uses the Redis protocol and it’s built on RocksDB https://github.com/apache/kvrocks

8. xnvme

   7 3 263 8.4 C

   Portable and high-performance libraries and tools for NVMe devices as well as support for traditional/legacy storage devices/interfaces.

   

9. SaaSHub

   www.saashub.com featured

   SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

   

10. KVSSD

    8 1 231 0.0 C

    KV SSD host software including APIs and drivers

    

11. documentation

    9 9 84 1.8

    A datastore aiming at linear scalability up to the yottabyte range. Inspired by dynamo and cassandra. (by yottaStore)

    

12. uNVMe

    10 1 98 10.0 C++

    KV and LBA SSD userspace NVMe driver

    

    https://github.com/OpenMPDK/uNVMe/blob/master/doc/uNVMe2.0_S...

    I can't find detailed spec sheets detailing which NVMe command sets are supported even for their enterprise drives.

13. Aerospike

    11 16 1,188 8.8 C

    Aerospike Database Server – flash-optimized, in-memory, nosql database

    

Suggest a related project