Rust datafusion

Open-source Rust projects categorized as datafusion
Edit details
Topics: Rust Arrow SQL Spark Query
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured

Top 6 Rust datafusion Projects

  • datafusion

    Apache DataFusion SQL Query Engine

    • Project mention: Velox: Meta's Unified Execution Engine [pdf] | news.ycombinator.com | 2024-03-25

    Python's Substrait seems like the biggest/most-used competitor-ish out there. I'd love some compare & contrast; my sense is that Substrait has a smaller ambition, and more wants to be a language for talking about execution rather than a full on execution engine. https://github.com/substrait-io/substrait

    We can also see from the DataFusion discussion that they too see themselves as a bit of a Velox competitor. https://github.com/apache/arrow-datafusion/discussions/6441

  • roapi

    Create full-fledged APIs for slowly moving datasets without writing a single line of code.

    • Project mention: Full-fledged APIs for slowly moving datasets without writing code | news.ycombinator.com | 2023-10-25

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • datafusion-comet

    Apache DataFusion Comet Spark Accelerator

    • Project mention: Apache Arrow DataFusion Comet Spark Accelerator | news.ycombinator.com | 2024-03-07

  • seafowl

    Analytical database for data-driven Web applications 🪶

    • Project mention: Gcsfuse: A user-space file system for interacting with Google Cloud Storage | news.ycombinator.com | 2023-09-06

    In case you're interested in scale-to-zero database hosting, a few months ago I paired gcsfuse with Seafowl [0][1], an early stage open source database written in Rust. Was a lot of fun balancing tradeoffs that are usually not possible with classical databases e.g. Postgres. Thank you gcsfuse contributors.

    [0] https://seafowl.io

  • kamu-cli

    New generation decentralized data lake and a streaming data pipeline

  • datafusion-objectstore-s3

    S3 as an ObjectStore for DataFusion

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Rust datafusion related posts

  • Apache Arrow DataFusion Comet Spark Accelerator

    1 project | news.ycombinator.com | 7 Mar 2024

  • Transforming Postgres into a Fast OLAP Database

    3 projects | news.ycombinator.com | 7 Feb 2024

  • Apache Arrow DataFusion

    1 project | news.ycombinator.com | 1 Oct 2023

  • Polars: Computing a new column from multiple columns - there must be a better way

    1 project | /r/rust | 4 May 2023

  • Fluent query library

    1 project | /r/rust | 10 Oct 2022

  • Rust for Data Engineering

    2 projects | /r/dataengineering | 22 Jun 2022

  • Ballista: Distributed compute platform implemented in Rust using Apache Arrow.

    1 project | /r/compsci | 11 Jun 2022
  • A note from our sponsor - InfluxDB
    www.influxdata.com | 8 May 2024
    Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →

Index

What are some of the best open-source datafusion projects in Rust? This list will help you:

Project Stars
1 datafusion 5,086
2 roapi 3,087
3 datafusion-comet 417
4 seafowl 355
5 kamu-cli 278
6 datafusion-objectstore-s3 57

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com