Declarative Multi-Engine Data Stack with Ibis

This page summarizes the projects mentioned and recommended in the original post on dev.to

InfluxDB – Built for High-Performance Time Series Workloads
InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured
  1. kuzu

    Embedded property graph database built for speed. Vector search and full-text search built in. Implements Cypher.

    KuzuDB

  2. InfluxDB

    InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.

    InfluxDB logo
  3. chdb

    chDB is an in-process OLAP SQL Engine 🚀 powered by ClickHouse

    Offloading part of a SQL query to serverless engines with DuckDB, polars, DataFusion, chdb etc.

  4. multi-engine-stack-ibis

    The code implemented in this post is available on GitHub^[In order to quickly try out repo, I also provide a nix flake]. The reference work in the newsletter with original implementation is here.

  5. multi-engine-data-stack

    The code implemented in this post is available on GitHub^[In order to quickly try out repo, I also provide a nix flake]. The reference work in the newsletter with original implementation is here.

  6. dplyr

    dplyr: A grammar of data manipulation

    One pandas limitation is that it has its own API that does not quite map back to relational algebra. Ibis is such a library that's literally built by people who built pandas to provide a sane expressions system that can be mapped back to multiple SQL backends. Ibis takes inspiration from the dplyr R package to build a new expression system that can easily map back to relational algebra and thus compile to SQL. It also is declarative in style, enabling us to apply database style optimizations on the complete logical plan or the expression. Ibis is a key component for enabling composability as highlighted in the excellent composable codex.

  7. Apache Arrow

    Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics

    Apache Arrow

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • Show HN: HelixDB – Open-Source Vector-Graph Database for AI Applications (Rust)

    5 projects | news.ycombinator.com | 13 May 2025
  • Waiting for Postgres 18: Accelerating Disk Reads with Asynchronous I/O

    3 projects | news.ycombinator.com | 7 May 2025
  • ClickHouse gets lazier (and faster): Introducing lazy materialization

    5 projects | news.ycombinator.com | 22 Apr 2025
  • Reproducing Hacker News writing style fingerprinting

    2 projects | news.ycombinator.com | 16 Apr 2025
  • Cloudflare R2 Data Catalog: Managed Apache Iceberg tables with zero egress fees

    1 project | news.ycombinator.com | 11 Apr 2025