pqrs
parquet2
Our great sponsors
pqrs | parquet2 | |
---|---|---|
4 | 6 | |
249 | 347 | |
- | - | |
4.9 | 3.2 | |
23 days ago | 8 months ago | |
Rust | Rust | |
Apache License 2.0 | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
pqrs
-
Querying Postgres Tables Directly from DuckDB
This won't let you ETL from PG to parquet, but I used this in anger the other day https://github.com/manojkarthick/pqrs Worked quite well for my purposes!
-
Holy Uck Fast Analysis with DuckDB and Pyarrow
Shameless plug, my project exposes the common Parquet operations using a Rust CLI tool using the Rust API for Apache Arrow and can be used without any Java/Hadoop/Spark dependencies. Also available a static binary.
https://github.com/manojkarthick/pqrs
- Pqrs: A Command line tool for inspecting Parquet files
- pqrs: A parquet-tools replacement in Rust using Apache Arrow
parquet2
-
Rust is showing a lot of promise in the DataFrame / tabular data space
[arrow2](https://github.com/jorgecarleitao/arrow2) and [parquet2](https://github.com/jorgecarleitao/parquet2) are great foundational libraries for and DataFrame libs in Rust.
-
::lending-iterator — Lending/streaming Iterators on Stable Rust (and a pinch of HKT)
This is so freaking life-saving! - we have been using StreamingIterator and FallibleStreamingIterator in libraries (arrow2 and parquet2) and the existing landscape is quite confusing for new users!
- Anda para aqui alguém a brincar com Rust (linguagem)?
-
Parquet2 0.9 released (and a request for feedback)
Thanks a lot for your feedback. Based on it I am proposing the following change: https://github.com/jorgecarleitao/parquet2/pull/78
-
parquet2 0.3.0, with native support to read async
release on github.
What are some alternatives?
Apache Parquet - Apache Parquet
parquet-format-rs - Apache Parquet format for Rust, hosting the Thrift definition file and the generated .rs file
deno - A modern runtime for JavaScript and TypeScript.
rust-brotli - Brotli compressor and decompressor written in rust that optionally avoids the stdlib
ballista - Distributed compute platform implemented in Rust, and powered by Apache Arrow.
roapi - Create full-fledged APIs for slowly moving datasets without writing a single line of code.
arrow2 - Transmute-free Rust library to work with the Arrow format
rust - Rust for the xtensa architecture. Built in targets for the ESP32 and ESP8266
inkwell - It's a New Kind of Wrapper for Exposing LLVM (Safely)
raku-Dan - Top level raku Data ANalysis Module
arrow-rs - Official Rust implementation of Apache Arrow