Solutions like Dependabot or Renovate update but don't merge dependencies. You need to do it manually while it could be fully automated! Add a Merge Queue to your workflow and stop caring about PR management & merging. Try Mergify for free. Learn more →
Top 9 Rust Arrow Projects
-
-
Project mention: GlareDB: An open source SQL database to query and analyze distributed data | /r/dataengineering | 2023-06-08
Apache Arrow is a pretty common memory structure these days. Datafusion is an open query engine built in Rust started by Andy Grove.
-
SonarQube
Static code analysis for 29 languages.. Your projects are multi-language. So is SonarQube analysis. Find Bugs, Vulnerabilities, Security Hotspots, and Code Smells so you can release quality code every time. Get started analyzing your projects today for free.
-
Project mention: Tuql: Automatically create a GraphQL server from a SQLite database | news.ycombinator.com | 2023-04-25
If your use case is read-only I suggest taking a look at roapi[1]. It supports multiple read frontends (GraphQL, SQL, REST) and many backends like SQLite, JSON, google sheets, MySQL, etc.
-
> Is Rust's compile-time GC about something other than performance somehow?
AFAIK, memory safety and language features as RAII is also available in C++, for instance. About the reasons for slow compilation, take a look at https://www.reddit.com/r/rust/comments/xna9mb/why_are_rust_p...
Not having a GC is also about not having a runtime as you mention (e.g. nice for creating Python extensions and embedded systems programming) and also more runtime deterministic performance: on that, if I'm not mistaken that was the reason for Discourse switching to Rust and also, e.g.: "the choice of Rust as the main execution language avoids the overhead of GC pauses and results in deterministic processing times" https://github.com/apache/arrow-ballista/blob/main/README.md
-
-
This won't let you ETL from PG to parquet, but I used this in anger the other day https://github.com/manojkarthick/pqrs Worked quite well for my purposes!
-
-
InfluxDB
Collect and Analyze Billions of Data Points in Real Time. Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.
-
-
Project mention: Looking for co-founder for a blockchain data indexing project | news.ycombinator.com | 2023-09-05
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
The latest post mention was on 2023-09-05.
Rust Arrow related posts
- Polars
- Ballista (Rust) vs Apache Spark. A Tale of Woe.
- If you could ask the creators of pandas for one additional feature, what would it be?
- Polars cookbook (Jupyter)
- [Crowdsourcing] Is there any code you really wished used named function arguments?
- Polars vs Pandas: A Brief Tale of Two DataFrame Libraries 🐼⚡🐻
- GlareDB: An open source SQL database to query and analyze distributed data
-
A note from our sponsor - Mergify
blog.mergify.com | 25 Sep 2023
Index
What are some of the best open-source Arrow projects in Rust? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | polars | 20,406 |
| 2 | arrow-datafusion | 4,016 |
| 3 | roapi | 2,907 |
| 4 | arrow-ballista | 923 |
| 5 | duckdb-rs | 261 |
| 6 | pqrs | 192 |
| 7 | parquet-wasm | 175 |
| 8 | myval | 57 |
| 9 | skar | 14 |
Updating dependencies is time-consuming.
Solutions like Dependabot or Renovate update but don't merge dependencies. You need to do it manually while it could be fully automated! Add a Merge Queue to your workflow and stop caring about PR management & merging. Try Mergify for free.
blog.mergify.com