Rust Arrow

Open-source Rust projects categorized as Arrow Edit details
Related topics: #Rust #Parquet #Dataframe #datafusion #Python

Top 6 Rust Arrow Projects

  • polars

    Fast multi-threaded DataFrame library in Rust | Python | Node.js

    Project mention: why everyone keeps comparing Go with Rust? | reddit.com/r/golang | 2022-06-25

    Rust ⚙️ is well suited for core system machinery. Think dataframes for data infrastructure. Polars is a faster backend for Python Pandas.

  • arrow-datafusion

    Apache Arrow DataFusion SQL Query Engine

    Project mention: Rust for Data Engineering | reddit.com/r/dataengineering | 2022-06-22

    Projects like polars (a faster pandas) and apache arrow datafusion (a distributed query engine like spark that aims to be faster and more memory efficient), are getting there.

  • SonarLint

    Clean code begins in your IDE with SonarLint. Up your coding game and discover issues early. SonarLint is a free plugin that helps you find & fix bugs and security issues from the moment you start writing code. Install from your favorite IDE marketplace today.

  • roapi

    Create full-fledged APIs for slowly moving datasets without writing a single line of code.

    Project mention: Dsq: Commandline tool for running SQL queries against JSON, CSV, Parquet, etc. | news.ycombinator.com | 2022-01-11

    Neat! I have also built a similar project in Rust https://github.com/roapi/roapi/tree/main/columnq-cli :)

  • parquet2

    Fastest and safest Rust implementation of parquet. `unsafe` free. Integration-tested against pyarrow

    Project mention: Anda para aqui alguém a brincar com Rust (linguagem)? | reddit.com/r/devpt | 2022-05-09

  • pqrs

    Command line tool for inspecting Parquet files

    Project mention: Holy Uck Fast Analysis with DuckDB and Pyarrow | news.ycombinator.com | 2022-04-30

    Shameless plug, my project exposes the common Parquet operations using a Rust CLI tool using the Rust API for Apache Arrow and can be used without any Java/Hadoop/Spark dependencies. Also available a static binary.

    https://github.com/manojkarthick/pqrs

  • parquet-wasm

    Rust-based WebAssembly bindings to read and write Apache Parquet data

    Project mention: Why isn’t there a decent file format for tabular data? | news.ycombinator.com | 2022-05-03
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2022-06-25.

Rust Arrow related posts

Index

What are some of the best open-source Arrow projects in Rust? This list will help you:

Project Stars
1 polars 6,582
2 arrow-datafusion 2,166
3 roapi 1,482
4 parquet2 176
5 pqrs 89
6 parquet-wasm 59
Find remote jobs at our new job board 99remotejobs.com. There are 2 new remote jobs listed recently.
Are you hiring? Post a new remote job listing for free.

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com