Ask HN: Why are there no open source NVMe-native key value stores in 2023?

• KVRocks

  2 46 10.0 C++

  RocksDB compatible key value store and MyRocks compatible storage engine designed for KV SSD (by OpenMPDK)

  

• InfluxDB

  www.influxdata.com featured

  Purpose built for real-time analytics at any scale. InfluxDB Platform is powered by columnar analytics, optimized for cost-efficient storage, and built with open data standards.

  

• ScaleStore

  2 113 3.4 C++

  This is the source code for our (Tobias Ziegler, Carsten Binnig and Viktor Leis) published paper at SIGMOD’22: ScaleStore: A Fast and Cost-Efficient Storage Engine using DRAM, NVMe, and RDMA.

  

  I don't remember exactly why I have any of them saved, but these are some experimental data stores that seems to be fitting what you're looking for somewhat:

  - https://github.com/DataManagementLab/ScaleStore - "A Fast and Cost-Efficient Storage Engine using DRAM, NVMe, and RDMA"

  - https://github.com/unum-cloud/udisk - "The fastest ACID-transactional persisted Key-Value store designed for NVMe block-devices with GPU-acceleration and SPDK to bypass the Linux kernel."

  - https://github.com/capsuleman/ssd-nvme-database - "Columnar database on SSD NVMe"

• udisk

  1 53 1.8

  The fastest ACID-transactional persisted Key-Value store designed as modified LSM-Tree for NVMe block-devices with GPU-acceleration and SPDK to bypass the Linux kernel

  

  I don't remember exactly why I have any of them saved, but these are some experimental data stores that seems to be fitting what you're looking for somewhat:

  - https://github.com/DataManagementLab/ScaleStore - "A Fast and Cost-Efficient Storage Engine using DRAM, NVMe, and RDMA"

  - https://github.com/unum-cloud/udisk - "The fastest ACID-transactional persisted Key-Value store designed for NVMe block-devices with GPU-acceleration and SPDK to bypass the Linux kernel."

  - https://github.com/capsuleman/ssd-nvme-database - "Columnar database on SSD NVMe"

• ssd-nvme-database

  1 13 10.0 C++

  Columnar database on SSD NVMe

  I don't remember exactly why I have any of them saved, but these are some experimental data stores that seems to be fitting what you're looking for somewhat:

  - https://github.com/DataManagementLab/ScaleStore - "A Fast and Cost-Efficient Storage Engine using DRAM, NVMe, and RDMA"

  - https://github.com/unum-cloud/udisk - "The fastest ACID-transactional persisted Key-Value store designed for NVMe block-devices with GPU-acceleration and SPDK to bypass the Linux kernel."

  - https://github.com/capsuleman/ssd-nvme-database - "Columnar database on SSD NVMe"

• solid_cache

  5 794 9.0 Ruby

  A database-backed ActiveSupport::Cache::Store

  

  Is that discussion/implementation of nvme available somewhere in public?

  https://github.com/rails/solid_cache didn't include anything about NVME that I could find.

• kvrocks

  23 3,460 9.6 C++

  Apache Kvrocks is a distributed key value NoSQL database that uses RocksDB as storage engine and is compatible with Redis protocol.

  

  There’s Kvrocks. It uses the Redis protocol and it’s built on RocksDB https://github.com/apache/kvrocks

• xnvme

  3 226 8.7 C

  Portable and high-performance libraries and tools for NVMe devices as well as support for traditional/legacy storage devices/interfaces.

  

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

• KVSSD

  1 229 0.0 C

  KV SSD host software including APIs and drivers

  

• yottaStore

  9 81 1.8

  A datastore aiming at linear scalability up to the yottabyte range. Inspired by dynamo and cassandra.

  

• uNVMe

  1 95 10.0 C++

  KV and LBA SSD userspace NVMe driver

  

  https://github.com/OpenMPDK/uNVMe/blob/master/doc/uNVMe2.0_S...

  I can't find detailed spec sheets detailing which NVMe command sets are supported even for their enterprise drives.

• Aerospike

  16 1,044 8.7 C

  Aerospike Database Server – flash-optimized, in-memory, nosql database

  

Suggest a related project