column-store

Open-source projects categorized as column-store
Language: + Python + Rust + C++ + C

Top 5 column-store Open-Source Projects

  • skytable

    Skytable is a modern scalable NoSQL database with BlueQL, designed for performance, scalability and flexibility. Skytable gives you spaces, models, data types, complex collections and more to build powerful experiences

  • Project mention: Show HN: Skytable's new NoSQL engine BlueQL with injection safety, improved perf | news.ycombinator.com | 2023-12-10

    Hey HN!

    I've been working on Skytable since 2020 and after several iterations from a simple K/V store, we've walked the path to this release. The goal of Skytable is to deliver a solid foundation for building data intensive applications.

    Skytable's primary goal is performance and scale. Even with a query language it can outperform K/V stores which use simple commands (benchmarks will be shared in another post).

    Several implementations in Skytable (especially around query evaluation and execution) are fundamentally different from SQL and even NoSQL counterparts and there are some entirely new concepts which might make it a little hard to grasp.

    BlueQL is a very important part of Skytable and it employs some interesting concepts to try and reduce the surface for injection attacks and tries to be a modern and secure alternative to SQL.

    - Source code: https://github.com/skytable/skytable

  • stonedb

    StoneDB is an Open-Source MySQL HTAP and MySQL-Native DataBase for OLTP, Real-Time Analytics, a counterpart of MySQLHeatWave. (https://stonedb.io)

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • stanchion

    A SQLite extension that brings column-oriented tables to SQLite

  • Project mention: Show HN: Stanchion – Column-oriented tables in SQLite | news.ycombinator.com | 2024-01-31

    The "Data Storage Internals" section[1] of the README sounds to me like it has its own column-oriented format for these tables, at least that's how I'm reading the part about segments. Is that the case? If so, have you tried using Apache Arrow or Parquet to see how they compare?

    [1] https://github.com/dgllghr/stanchion#data-storage-internals

  • boxball

    Prebuilt Docker images with Retrosheet's complete baseball history data for many analytical frameworks. Includes Postgres, cstore_fdw, MySQL, SQLite, Clickhouse, Drill, Parquet, and CSV.

  • nosqlapi

    nosqlapi is a library for building standard NOSQL python libraries.

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

column-store related posts

  • A SQLite extension that brings column-oriented tables to SQLite

    5 projects | news.ycombinator.com | 1 Feb 2024
  • Show HN: Stanchion – Column-oriented tables in SQLite

    3 projects | news.ycombinator.com | 31 Jan 2024

Index

What are some of the best open-source column-store projects? This list will help you:

Project Stars
1 skytable 2,311
2 stonedb 854
3 stanchion 625
4 boxball 110
5 nosqlapi 11

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com