parquet2
rust-threadpool
Our great sponsors
| parquet2 | rust-threadpool | |
|---|---|---|
| 6 | 4 | |
| 347 | 527 | |
| - | 2.1% | |
| 3.2 | 0.0 | |
| 8 months ago | almost 2 years ago | |
| Rust | Rust | |
| GNU General Public License v3.0 or later | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
parquet2
-
Rust is showing a lot of promise in the DataFrame / tabular data space
[arrow2](https://github.com/jorgecarleitao/arrow2) and [parquet2](https://github.com/jorgecarleitao/parquet2) are great foundational libraries for and DataFrame libs in Rust.
-
::lending-iterator — Lending/streaming Iterators on Stable Rust (and a pinch of HKT)
This is so freaking life-saving! - we have been using StreamingIterator and FallibleStreamingIterator in libraries (arrow2 and parquet2) and the existing landscape is quite confusing for new users!
- Anda para aqui alguém a brincar com Rust (linguagem)?
-
Parquet2 0.9 released (and a request for feedback)
Thanks a lot for your feedback. Based on it I am proposing the following change: https://github.com/jorgecarleitao/parquet2/pull/78
-
parquet2 0.3.0, with native support to read async
release on github.
rust-threadpool
-
Any alternative threadpool to rayon?
threadpool: Requires a channel to send back results. `join` will deadlock if called within the pool.
-
Should I join threads asap?
I recommend using a threadpool: https://crates.io/crates/threadpool It saves you the work and runtime of handling, starting and stoping threads
-
I wrote a post about background processing library - Fang
nice point. I think for cases that you mentioned there are two options: 1. If work that should be done is lightweight, tokio tasks or futures can be used. 2. if tasks are heavy and long running, there are some libraries that can execute tasks in threads - https://github.com/rust-threadpool/rust-threadpool , https://github.com/crossbeam-rs/crossbeam
-
running many threads in same time
If I understand correctly, you're probably looking for a Threadpool.
What are some alternatives?
parquet-format-rs - Apache Parquet format for Rust, hosting the Thrift definition file and the generated .rs file
crossbeam - Tools for concurrent programming in Rust
rust-brotli - Brotli compressor and decompressor written in rust that optionally avoids the stdlib
profiler - Firefox Profiler — Web app for Firefox performance analysis
roapi - Create full-fledged APIs for slowly moving datasets without writing a single line of code.
sangfroid - A load balanced threadpool.
arrow2 - Transmute-free Rust library to work with the Arrow format
ppl - Parallelo Parallel Library (PPL) is a small parallel framework that brings Structured Parallel Programming in Rust.
inkwell - It's a New Kind of Wrapper for Exposing LLVM (Safely)
pqrs - Command line tool for inspecting Parquet files
arrow-rs - Official Rust implementation of Apache Arrow
odbc2parquet - A command line tool to query an ODBC data source and write the result into a parquet file.