Rust is showing a lot of promise in the DataFrame / tabular data space

1. polars

   1 155 38,725 10.0 Rust

   Extremely fast Query Engine for DataFrames, written in Rust

   

   [Polars](https://github.com/pola-rs/polars) is a blazing fast DataFrame library with a beautiful user interface and an awesome getting started guide. The impressive h2o benchmark results have gotten Polars a lot of users.

2. SaaSHub

   www.saashub.com featured

   SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

   

3. db-benchmark

   2 92 346 0.0 R

   reproducible benchmark of database-like ops

   

   [Polars](https://github.com/pola-rs/polars) is a blazing fast DataFrame library with a beautiful user interface and an awesome getting started guide. The impressive h2o benchmark results have gotten Polars a lot of users.

4. datafusion

   3 71 8,871 10.0 Rust

   Apache DataFusion SQL Query Engine

   

   [arrow-datafusion](https://github.com/apache/arrow-datafusion) is another great DataFrame library, especially if you like running SQL queries. It's so easy to query a Parquet / CSV dataset with SQL using DataFusion. I've run local benchmarks and it's super fast. The DataFusion docs are a bit lacking, which is a shame, for such a developed and amazing library. I hope to make these better and help spread the world about how truly amazing this lib is.

5. arrow2

   4 26 1,071 0.0 Rust

   Discontinued Transmute-free Rust library to work with the Arrow format

   [arrow2](https://github.com/jorgecarleitao/arrow2) and [parquet2](https://github.com/jorgecarleitao/parquet2) are great foundational libraries for and DataFrame libs in Rust.

6. parquet2

   5 6 384 0.9 Rust

   Fastest and safest Rust implementation of parquet. `unsafe` free. Integration-tested against pyarrow

   

   [arrow2](https://github.com/jorgecarleitao/arrow2) and [parquet2](https://github.com/jorgecarleitao/parquet2) are great foundational libraries for and DataFrame libs in Rust.

7. delta-rs

   6 33 3,238 9.8 Rust

   A native Rust library for Delta Lake, with bindings into Python

   

   I'm working on [delta-rs](https://github.com/delta-io/delta-rs) which brings the power of Delta Lake to the Rust community. CSV / Parquet lakes are limited and Delta Lakes offer a ton of advantages (versioned data, time travel, ACID transactions, schema enforcement, etc). We're working to bring full Polars and DataFusion support to delta-rs, see the roadmap.

8. influxdb_iox

   7 14 1,803 9.9 Rust

   Discontinued Pronounced (influxdb eye-ox), short for iron oxide. This is the new core of InfluxDB written in Rust on top of Apache Arrow.

   

   Already is: https://github.com/influxdata/influxdb_iox Just still a work in progress.

9. PyO3

   8 161 15,785 9.7 Rust

   Rust bindings for the Python interpreter

   

   If you’re interested in python bindings take a look at https://pyo3.rs/

10. kafka-delta-ingest

    9 6 434 7.0 Rust

    A highly efficient daemon for streaming data from Kafka into Delta Lake

    

    kafka-delta-ingest is a good project to get streaming data into a Delta Lake. Here's a great talk on the topic.

Suggest a related project