Top 4 columnar-storage Open-Source Projects

• cstore_fdw

  6 1,738 2.6 C

  Columnar storage extension for Postgres built as a foreign data wrapper. Check out https://github.com/citusdata/citus for a modernized columnar storage implementation built as a table access method.

  

Project mention: Moving a Billion Postgres Rows on a $100 Budget | news.ycombinator.com | 2024-02-21

Columnar store PostgreSQL extension exists, here are two but I think I’m missing at least another one:

https://github.com/citusdata/cstore_fdw

https://github.com/hydradatabase/hydra

You can also connect other stores using the foreign data wrappers, like parquet files stored on an object store, duckdb, clickhouse… though the joins aren’t optimised as PostgreSQL would do full scan on the external table when joining.

• column

  3 1,383 4.1 Go

  High-performance, columnar, in-memory store with bitmap indexing in Go

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• frostdb

  5 1,223 9.5 Go

  ❄️ Coolest database around 🧊 Embeddable column database written in Go.

  

Project mention: Polar Signals Cloud Is Generally Available | news.ycombinator.com | 2023-10-10

> In addition to that we built a custom columnar database

I did some digging in your blog history and it seems that is referencing https://www.polarsignals.com/blog/posts/2022/07/22/frostdb-i... and digging into the "but why?" section <https://github.com/polarsignals/frostdb#why-you-should-use-f...> seems to imply you favored the embedded feature over having something standalone, but I would enjoy hearing (or reading a blog post!) about why you felt it was a better use of your engineering to make your own columar DB versus using one of the existing columanr dbs that I have seen referenced a ton in other Show HN announcements around both logging and metrics services

• KuiBaDB

  2 311 0.0 Rust

  Another OLAP database

  

columnar-storage related posts

• Polar Signals Cloud Is Generally Available

  1 project | news.ycombinator.com | 10 Oct 2023

• Pg_squeeze: An extension to fix table bloat

  3 projects | news.ycombinator.com | 4 Oct 2022

• ArcticDB: A Database for Observability

  3 projects | news.ycombinator.com | 4 May 2022

• arcticDB: embedded columnar database written in Go

  2 projects | /r/golang | 4 May 2022

• Creating a simple data pipeline

  1 project | /r/dataengineering | 20 May 2021
• A note from our sponsor - SaaSHub
  www.saashub.com | 24 May 2024

  SaaSHub helps you find the best software and product alternatives Learn more →

Index

Sponsored

SaaSHub - Software Alternatives and Reviews

SaaSHub helps you find the best software and product alternatives

www.saashub.com