Declarative Multi-Engine Data Stack with Ibis

This page summarizes the projects mentioned and recommended in the original post on dev.to

JetBrains - Tell us how you use coding tools. You may win a prize!
Are you a developer or a data analyst? Share your thoughts about your coding tools in our short survey and get a chance to win prizes!
surveys.jetbrains.com
featured
InfluxDB – Built for High-Performance Time Series Workloads
InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
www.influxdata.com
featured
  1. kuzu

    Embedded property graph database built for speed. Vector search and full-text search built in. Implements Cypher.

    KuzuDB

  2. JetBrains

    Tell us how you use coding tools. You may win a prize! Are you a developer or a data analyst? Share your thoughts about your coding tools in our short survey and get a chance to win prizes!

    JetBrains logo
  3. chdb

    chDB is an in-process OLAP SQL Engine 🚀 powered by ClickHouse

    Offloading part of a SQL query to serverless engines with DuckDB, polars, DataFusion, chdb etc.

  4. multi-engine-stack-ibis

    The code implemented in this post is available on GitHub^[In order to quickly try out repo, I also provide a nix flake]. The reference work in the newsletter with original implementation is here.

  5. multi-engine-data-stack

    The code implemented in this post is available on GitHub^[In order to quickly try out repo, I also provide a nix flake]. The reference work in the newsletter with original implementation is here.

  6. dplyr

    dplyr: A grammar of data manipulation

    One pandas limitation is that it has its own API that does not quite map back to relational algebra. Ibis is such a library that's literally built by people who built pandas to provide a sane expressions system that can be mapped back to multiple SQL backends. Ibis takes inspiration from the dplyr R package to build a new expression system that can easily map back to relational algebra and thus compile to SQL. It also is declarative in style, enabling us to apply database style optimizations on the complete logical plan or the expression. Ibis is a key component for enabling composability as highlighted in the excellent composable codex.

  7. Apache Arrow

    Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics

    Apache Arrow

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • This embedded database runs SQL on dataframes meet DuckDB

    2 projects | dev.to | 28 Aug 2025
  • Understanding "Dynamic Programming" it's not referring to "computer programming"

    1 project | news.ycombinator.com | 21 Jul 2025
  • Strategies for Fast Lexers

    5 projects | news.ycombinator.com | 14 Jul 2025
  • 🧠 From Hive and Elastic to ClickHouse: What Surprised Me

    1 project | dev.to | 8 Jul 2025
  • Show HN: Hacker News historic upvote and score data

    2 projects | news.ycombinator.com | 3 Jun 2025

Did you know that C++ is
the 7th most popular programming language
based on number of references?