|5 days ago||15 days ago|
|GNU General Public License v3.0 or later||Mozilla Public License 2.0|
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Arrow2 0.9 has been released
6 projects | reddit.com/r/rust | 14 Jan 2022
For the IPC format, an example is here: https://github.com/jorgecarleitao/arrow2/tree/main/examples/ipc_pyarrow6 projects | reddit.com/r/rust | 14 Jan 2022
Should I bump to 2021 edition?
1 project | reddit.com/r/rust | 4 Nov 2021
I have this PR that just bumps it with no code changes. How will I affect users with this change?
arrow2 0.6.0 has been released (now compatible with `std::Vec`)!
1 project | reddit.com/r/rust | 7 Oct 2021
[Question] An efficient way of iterating over the bits of an integer?
1 project | reddit.com/r/rust | 20 Sep 2021
If you find more efficient way, please let us know in https://github.com/jorgecarleitao/arrow2, we are very interested in this problem.
Polars 0.16.0 is out!
7 projects | reddit.com/r/rust | 14 Sep 2021
See more in this PR: https://github.com/jorgecarleitao/arrow2/pull/3857 projects | reddit.com/r/rust | 14 Sep 2021
This release comes with a lot of features, performance improvements and bug fixes read the changelog. Most notable change may be that this polars release now is based on arrow2.
This week in Datafuse #6
5 projects | reddit.com/r/rust | 9 Sep 2021
arrow2 #346: Added support for compute to BinaryArray by @zhyass
This week in Datafuse #5
4 projects | reddit.com/r/rust | 1 Sep 2021
arrow2 #344: Bumped tonic and prost in flight by @PsiACE
[Help] Performant write of comparison to a LSB bitmap
3 projects | reddit.com/r/rust | 21 Mar 2021
Does Rust's performance advantage over python extend to numpy/pandas?
1 project | reddit.com/r/bioinformatics | 4 Jan 2022
It has some impressive benchmarks https://h2oai.github.io/db-benchmark/
Is Data Science 90% boring and 10% mega-interesting?
1 project | reddit.com/r/datascience | 28 Dec 2021
Programming languages for data roles Big Tech [OC]
1 project | reddit.com/r/learnmachinelearning | 22 Dec 2021
It’s not just speed but also memory usage and parallelization potential. Look how many times pandas is out of memory https://h2oai.github.io/db-benchmark/
The polars dataframe library now also exposes bindings to NodeJS
2 projects | reddit.com/r/node | 22 Dec 2021
Polars is a blazingly fast DataFrame library. Its written in Rust and until now exposed only bindings in Python. Its one of the best performing solutions in H2oAi's db-benchmark
Polars, lightning-fast DataFrame library
1 project | reddit.com/r/Python | 17 Dec 2021
Polars: Lightning-fast DataFrame library for Rust and Python
13 projects | news.ycombinator.com | 16 Dec 2021
Hmmm .. in the linked benchmarks , DataFrames.jl (Julia library) appears to be fairly competitive.13 projects | news.ycombinator.com | 16 Dec 2021
Rust and what it needs to gain space in computation-oriented applications
7 projects | reddit.com/r/rust | 24 Nov 2021
You should check out polars, datafusion, influxdb iox and databend, all written in native Rust and powered by the Apache Arrow format. Polars in particular is pretty dam fast and has bindings for Python.
Database-Like Ops Benchmark
1 project | news.ycombinator.com | 20 Nov 2021
A better dtypes for pandas dataframes pulled from Postgres
1 project | reddit.com/r/datascience | 14 Nov 2021
Here is a good comparison: https://h2oai.github.io/db-benchmark/
What are some alternatives?
arrow-datafusion - Apache Arrow DataFusion and Ballista query engines
polars - Fast multi-threaded DataFrame library in Rust | Python | Node.js
sktime - A unified framework for machine learning with time series
DataFramesMeta.jl - Metaprogramming tools for DataFrames
Apache Arrow - Apache Arrow is a multi-language toolbox for accelerated data interchange and in-memory processing
csvs-to-sqlite - Convert CSV files into a SQLite database
julia - The Julia Programming Language
Preql - An interpreted relational query language that compiles to SQL.
databend - An elastic and reliable Serverless Data Warehouse, offers Blazing Fast Query and combines Elasticity, Simplicity, Low cost of the Cloud, built to make the Data Cloud easy
pyodide - Pyodide is a Python distribution for the browser and Node.js based on WebAssembly
tidytable - Tidy interface to 'data.table'