polars
Fast multi-threaded, hybrid-out-of-core query engine focussing on DataFrame front-ends (by ritchie46)
vaex
Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second 🚀 (by vaexio)
Our great sponsors
- SonarQube - Static code analysis for 29 languages.
- Revelo Payroll - Free Global Payroll designed for tech teams
- InfluxDB - Collect and Analyze Billions of Data Points in Real Time
- Onboard AI - Learn any GitHub repo in 59 seconds
| polars | vaex | |
|---|---|---|
| 133 | 7 | |
| 20,584 | 8,021 | |
| 3.8% | 0.5% | |
| 9.9 | 7.8 | |
| 5 days ago | about 1 month ago | |
| Rust | Python | |
| MIT License | MIT License |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
polars
Posts with mentions or reviews of polars.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-07-10.
-
What are you rewriting in rust?
I am a maintainer for a dataframe interface called polars
-
[Crowdsourcing] Is there any code you really wished used named function arguments?
For example with polars, the python library extensively uses named arguments, but in rust we have to use either a builder pattern or macros. The builder pattern tends to be much more verbose than the named argument equivalent. There is currently a draft PR implementing python style named arguments for some of the most common functions.
- Polars cookbook (Jupyter)
-
Working with Rust
Seeing a lot of great libraries coming out with python bindings in the data world e.g delta-rs Polars. I see it growing in this space as a C++ alternative
- Polars: alternativa ao Pandas
-
Benchmarking for Pandas and Polars Using CSV and Parquet File
e.g. https://github.com/pola-rs/polars/issues/8533
I have updated this issue https://github.com/pola-rs/polars/issues/8533, please kindly help to solve it. I have also sent similar issues to Pandas https://github.com/pandas-dev/pandas/issues/53249
-
Polars CLI is now available!
could you open up an issue in github
-
Data Engineering with Rust
https://github.com/jorgecarleitao/arrow2 https://github.com/apache/arrow-datafusion https://github.com/apache/arrow-ballista https://github.com/pola-rs/polars https://github.com/duckdb/duckdb
-
Polars query engine 0.29.0 released
A new release of polars https://github.com/pola-rs/polars/releases/tag/rs-0.29.0 query engine/ DataFrame library.
vaex
Posts with mentions or reviews of vaex.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2022-06-03.
-
preprocessing millions of records - how to speed up the processing
Try vaex, vaex, using lazy evaluation and parallel calculations, you should be fine.
- Polars: Lightning-fast DataFrame library for Rust and Python
- I wrote one of the fastest DataFrame libraries
What are some alternatives?
When comparing polars and vaex you can also consider the following projects:
modin - Modin: Scale your Pandas workflows by changing a single line of code
arrow-datafusion - Apache Arrow DataFusion SQL Query Engine
DataFrames.jl - In-memory tabular data in Julia
Apache Arrow - Apache Arrow is a multi-language toolbox for accelerated data interchange and in-memory processing
datatable - A Python package for manipulating 2-dimensional tabular data structures
db-benchmark - reproducible benchmark of database-like ops
rust-numpy - PyO3-based Rust bindings of the NumPy C-API
data.table - R's data.table package extends data.frame:
tidypolars - Tidy interface to polars
hdf5-rust - HDF5 for Rust
arrow2 - Transmute-free Rust library to work with the Arrow format
rust-csv - A CSV parser for Rust, with Serde support.