storage-engine

Open-source projects categorized as storage-engine
Edit details
Language: + C++ + Rust + PHP + Java + Go + C + Scala + JavaScript + C# + Python
Topics: Database NoSQL Storage Rust nosql-database
The modern identity platform for B2B SaaS
The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
workos.com
Sponsored

Top 20 storage-engine Open-Source Projects

  • RocksDB

    A library that provides an embeddable, persistent key-value store for fast storage.

    • Project mention: How to choose the right type of database | dev.to | 2024-02-28

    RocksDB: A high-performance embedded database optimized for multi-core CPUs and fast storage like SSDs. Its use of a log-structured merge-tree (LSM tree) makes it suitable for applications requiring high throughput and efficient storage, such as streaming data processing.

  • redpanda

    Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!

    • Project mention: Choosing Between a Streaming Database and a Stream Processing Framework in Python | dev.to | 2024-02-10

    Stream-processing platforms such as Apache Kafka, Apache Pulsar, or Redpanda are specifically engineered to foster event-driven communication in a distributed system and they can be a great choice for developing loosely coupled applications. Stream processing platforms analyze data in motion, offering near-zero latency advantages. For example, consider an alert system for monitoring factory equipment. If a machine's temperature exceeds a certain threshold, a streaming platform can instantly trigger an alert and engineers do timely maintenance.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • curve

    Curve is a sandbox project hosted by the CNCF Foundation. It's cloud-native, high-performance, and easy to operate. Curve is an open-source distributed storage system for block and shared file storage. (by opencurve)

    • Project mention: Google Cloud Storage FUSE | news.ycombinator.com | 2023-05-02

  • TileDB

    The Universal Storage Engine

    • Project mention: Ask HN: Who is hiring? (September 2023) | news.ycombinator.com | 2023-09-01

    - single cell genomics: in collaboration with the Chan-Zuckerberg Initiative, we recently released TileDB-SOMA for single cell data, with APIs for both Python and R built around a common storage specification: https://tiledb.com/blog/tiledb-101-single-cell

    With TileDB, all data — tables, genomics, images, videos, location, time-series — across multiple domains is captured as multi-dimensional arrays. TileDB Cloud implements a totally serverless infrastructure and delivers access control, easier data and code sharing and distributed computing at global scale, eliminating cluster management, minimizing TCO and promoting scientific collaboration and reproducibility.

    Website: https://tiledb.com

    GitHub: https://github.com/TileDB-Inc/TileDB

  • SleekDB

    Pure PHP NoSQL database with no dependency. Flat file, JSON based document database.

  • speedb

    A RocksDB compliant high performance scalable embedded key-value store

    • Project mention: FLaNK AI - 01 April 2024 | dev.to | 2024-04-01

  • engula

    Engula is a distributed key-value store, used as a cache, database, and storage engine.

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo

  • microstream

    High-Performance Java-Native-Persistence. Store and load any Java Object Graph or Subgraphs partially, Relieved of Heavy-weight JPA. Microsecond Response Time. Ultra-High Throughput. Minimum of Latencies. Create Ultra-Fast In-Memory Database Applications & Microservices.

    • Project mention: Permazen: Language-natural persistence to KV stores | news.ycombinator.com | 2023-09-19

    Personally, I found https://microstream.one/ interesting for simple persistance needs (haven't tried it, though).

  • SwayDB

    Persistent and in-memory key-value storage engine for JVM that scales on a single machine.

  • vasedb

    VaseDB is a NoSQL that supports multiple data types and transactions.

  • redux-persist-sensitive-storage

    redux-persist storage engine for react-native-sensitive-info

  • rust-csharp-ffi

    An example Rust + C# hybrid application

  • store

    High-Performance Java-Native-Persistence. Store and load any Java Object Graph or Subgraphs partially, Relieved of Heavy-weight JPA. Microsecond Response Time. Ultra-High Throughput. Minimum of Latencies. Create Ultra-Fast In-Memory Database Applications & Microservices. (by eclipse-store)

    • Project mention: EclipseStore – Databaseless Java Persistence for Microservices and Serverless | news.ycombinator.com | 2023-12-08

  • ReductStore

    A time series database for storing and managing large amounts of blob data

    • Project mention: Time Series Blob Data: ReductStore vs. MongoDB | dev.to | 2024-04-08

    In edge computing, managing time series blob data efficiently is critical for performance-sensitive applications. This blog post will compare ReductStore, a specialized time series database for unstructured data, and MongoDB, a widely-used NoSQL database.

  • pgrocks-fdw

    Bring RocksDB to PostgreSQL as an extension. It is the first foreign data wrapper (FDW) that introduces LSM-tree into PostgreSQL. The underneath storage engine can be RocksDB. The FDW also serves for VidarDB engine, a versatile storage engine for various workloads. See the link for more info about VidarDB engine.

  • uxf

    Uniform eXchange Format (uxf) is a plain text human readable optionally typed storage format that supports custom types. It may serve as a convenient alternative to csv, ini, json, sqlite, toml, xml, or yaml.

  • filefilego

    Decentralized Data Sharing Network - A Peer-to-peer, censorship-resistant, and a privacy-focused data sharing network

    • Project mention: Any new Opensource projects in (go) looking for contributors. I want to start my journey as an OSS contributor. | /r/golang | 2023-05-14

    If you are interested in blockchain and peer-to-peer systems feel free to join us: https://github.com/filefilego/filefilego

  • dustdata

    A data concurrency control key-value storage engine to Rustbase

  • parallax

    A persistent key-value store that is embeddable and optimized for fast storage. (by CARV-ICS-FORTH)

  • jisly

    The smallest PHP NoSQL database library, flat file JSON.

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

storage-engine related posts

Index

What are some of the best open-source storage-engine projects? This list will help you:

Project Stars
1 RocksDB 27,389
2 redpanda 8,784
3 curve 2,222
4 TileDB 1,762
5 SleekDB 873
6 speedb 822
7 engula 773
8 microstream 555
9 SwayDB 288
10 vasedb 252
11 redux-persist-sensitive-storage 247
12 rust-csharp-ffi 186
13 store 144
14 ReductStore 137
15 pgrocks-fdw 117
16 uxf 92
17 filefilego 60
18 dustdata 32
19 parallax 26
20 jisly 26

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com