|1 day ago||3 days ago|
|GNU General Public License v3.0 or later||MIT License|
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Arrow2 0.9 has been released
6 projects | reddit.com/r/rust | 14 Jan 2022
For the IPC format, an example is here: https://github.com/jorgecarleitao/arrow2/tree/main/examples/ipc_pyarrow6 projects | reddit.com/r/rust | 14 Jan 2022
Should I bump to 2021 edition?
1 project | reddit.com/r/rust | 4 Nov 2021
I have this PR that just bumps it with no code changes. How will I affect users with this change?
arrow2 0.6.0 has been released (now compatible with `std::Vec`)!
1 project | reddit.com/r/rust | 7 Oct 2021
[Question] An efficient way of iterating over the bits of an integer?
1 project | reddit.com/r/rust | 20 Sep 2021
If you find more efficient way, please let us know in https://github.com/jorgecarleitao/arrow2, we are very interested in this problem.
Polars 0.16.0 is out!
7 projects | reddit.com/r/rust | 14 Sep 2021
See more in this PR: https://github.com/jorgecarleitao/arrow2/pull/3857 projects | reddit.com/r/rust | 14 Sep 2021
This release comes with a lot of features, performance improvements and bug fixes read the changelog. Most notable change may be that this polars release now is based on arrow2.
This week in Datafuse #6
5 projects | reddit.com/r/rust | 9 Sep 2021
arrow2 #346: Added support for compute to BinaryArray by @zhyass
This week in Datafuse #5
4 projects | reddit.com/r/rust | 1 Sep 2021
arrow2 #344: Bumped tonic and prost in flight by @PsiACE
[Help] Performant write of comparison to a LSB bitmap
3 projects | reddit.com/r/rust | 21 Mar 2021
Polars DataFrame library 0.19.0 is out!
2 projects | reddit.com/r/rust | 19 Jan 2022
What would it take to recreate dplyr in Python?
3 projects | news.ycombinator.com | 17 Jan 2022
It says [here](https://github.com/pola-rs/polars/issues/580#issuecomment-82...) that Polars has zero copy for arrow and numpy.
Raku for the the scientist/PROGRAMMER that is hitting the limits of Python
7 projects | reddit.com/r/rakulang | 3 Jan 2022
polars is a DataFrame library in Rust, is it possible to have Raku call this library?
The polars dataframe library now also exposes bindings to NodeJS
2 projects | reddit.com/r/node | 22 Dec 2021
See the README
Writing Rust libraries for the Python scientific computing ecosystem
12 projects | reddit.com/r/rust | 19 Dec 2021
All the problems you describe are thing we also encountered in writing polars. Take a look at the py-polars directory in root. I believe we have done all you listed. :)12 projects | reddit.com/r/rust | 19 Dec 2021
Maybe you'll find some other inspiration with this lib: Polars (if you don't already know it)
Polars: Lightning-fast DataFrame library for Rust and Python
13 projects | news.ycombinator.com | 16 Dec 2021
Rust and what it needs to gain space in computation-oriented applications
7 projects | reddit.com/r/rust | 24 Nov 2021
You should check out polars, datafusion, influxdb iox and databend, all written in native Rust and powered by the Apache Arrow format. Polars in particular is pretty dam fast and has bindings for Python.
How to pass dataframes between Rust and Python?
4 projects | reddit.com/r/rust | 20 Nov 2021
A solution for either Polars or Datafusion (or something else?) would be fine. For both libraries, python packages exist, that contain the python bindings: https://github.com/pola-rs/polars/tree/master/py-polars https://github.com/apache/arrow-datafusion/tree/master/python4 projects | reddit.com/r/rust | 20 Nov 2021
It's working for me now. :-) To get it working, I used the code from the suggested directory as well as the class PyPolarsError, which I copied into a local module: https://github.com/pola-rs/polars/tree/master/py-polars/src/arrow_interop https://github.com/pola-rs/polars/blob/629f5012bcefaa3c9a9c1a236e64dc057e8d472c/py-polars/src/error.rs Besides the polars dependency, also these are needed:
What are some alternatives?
vaex - Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second 🚀
Apache Arrow - Apache Arrow is a multi-language toolbox for accelerated data interchange and in-memory processing
arrow-datafusion - Apache Arrow DataFusion and Ballista query engines
db-benchmark - reproducible benchmark of database-like ops
DataFrames.jl - In-memory tabular data in Julia
arrow-rs - Official Rust implementation of Apache Arrow
rust-csv - A CSV parser for Rust, with Serde support.
wgpu - Safe and portable GPU abstraction in Rust, implementing WebGPU API.
tokio-tungstenite - Tokio binding for Tungstenite, the Lightweight stream-based WebSocket implementation
tidypolars - Tidy interface to polars
dataframe-python-rust - Comparing Polars vs Pandas vs Rust native :)