Top 6 Rust Arrow Projects
-
Rust ⚙️ is well suited for core system machinery. Think dataframes for data infrastructure. Polars is a faster backend for Python Pandas.
-
Projects like polars (a faster pandas) and apache arrow datafusion (a distributed query engine like spark that aims to be faster and more memory efficient), are getting there.
-
SonarLint
Clean code begins in your IDE with SonarLint. Up your coding game and discover issues early. SonarLint is a free plugin that helps you find & fix bugs and security issues from the moment you start writing code. Install from your favorite IDE marketplace today.
-
Project mention: Dsq: Commandline tool for running SQL queries against JSON, CSV, Parquet, etc. | news.ycombinator.com | 2022-01-11
Neat! I have also built a similar project in Rust https://github.com/roapi/roapi/tree/main/columnq-cli :)
-
parquet2
Fastest and safest Rust implementation of parquet. `unsafe` free. Integration-tested against pyarrow
Project mention: Anda para aqui alguém a brincar com Rust (linguagem)? | reddit.com/r/devpt | 2022-05-09 -
Shameless plug, my project exposes the common Parquet operations using a Rust CLI tool using the Rust API for Apache Arrow and can be used without any Java/Hadoop/Spark dependencies. Also available a static binary.
-
Project mention: Why isn’t there a decent file format for tabular data? | news.ycombinator.com | 2022-05-03
Rust Arrow related posts
- Rust for Data Engineering
- Ballista: Distributed compute platform implemented in Rust using Apache Arrow.
- Arrow-Datafusion - Apache Arrow DataFusion and Ballista query engines
- Polars 0.22 is released!
- Best tool for larger than memory data
- Using Polars to analyze 1M+ Stack Overflow questions
- Anda para aqui alguém a brincar com Rust (linguagem)?
Index
What are some of the best open-source Arrow projects in Rust? This list will help you:
Project | Stars | |
---|---|---|
1 | polars | 6,582 |
2 | arrow-datafusion | 2,166 |
3 | roapi | 1,482 |
4 | parquet2 | 176 |
5 | pqrs | 89 |
6 | parquet-wasm | 59 |
Are you hiring? Post a new remote job listing for free.