parquet2
parquet-format-rs
Our great sponsors
| parquet2 | parquet-format-rs | |
|---|---|---|
| 6 | 1 | |
| 347 | 18 | |
| - | - | |
| 3.2 | 0.0 | |
| 7 months ago | almost 2 years ago | |
| Rust | Rust | |
| GNU General Public License v3.0 or later | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
parquet2
-
Rust is showing a lot of promise in the DataFrame / tabular data space
[arrow2](https://github.com/jorgecarleitao/arrow2) and [parquet2](https://github.com/jorgecarleitao/parquet2) are great foundational libraries for and DataFrame libs in Rust.
-
::lending-iterator — Lending/streaming Iterators on Stable Rust (and a pinch of HKT)
This is so freaking life-saving! - we have been using StreamingIterator and FallibleStreamingIterator in libraries (arrow2 and parquet2) and the existing landscape is quite confusing for new users!
- Anda para aqui alguém a brincar com Rust (linguagem)?
-
Parquet2 0.9 released (and a request for feedback)
Thanks a lot for your feedback. Based on it I am proposing the following change: https://github.com/jorgecarleitao/parquet2/pull/78
-
parquet2 0.3.0, with native support to read async
release on github.
parquet-format-rs
-
parquet2 0.3.0, with native support to read async
The biggest addition is native async reading via futures::AsyncRead and futures::AsyncSeek, which required a lot of (to be merged) changes upstream (changes to thrift rust compiler and parquet-format-rs). I placed those changes on a temporary crate until things are released there.
What are some alternatives?
rust-brotli - Brotli compressor and decompressor written in rust that optionally avoids the stdlib
Apache Thrift - Apache Thrift
roapi - Create full-fledged APIs for slowly moving datasets without writing a single line of code.
arrow2 - Transmute-free Rust library to work with the Arrow format
inkwell - It's a New Kind of Wrapper for Exposing LLVM (Safely)
pqrs - Command line tool for inspecting Parquet files
arrow-rs - Official Rust implementation of Apache Arrow
odbc2parquet - A command line tool to query an ODBC data source and write the result into a parquet file.
rust-threadpool - A very simple thread pool for parallel task execution
case-studies - Analysis of various tricky Rust code
ballista - Distributed compute platform implemented in Rust, and powered by Apache Arrow.