geopolars
polars
geopolars | polars | |
---|---|---|
3 | 144 | |
487 | 26,378 | |
6.4% | 3.4% | |
6.3 | 10.0 | |
3 months ago | 1 day ago | |
Rust | Rust | |
MIT License | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
geopolars
-
Polars DataFrame library 0.24.0 is released.
There is already a geopolars initiative: https://github.com/geopolars/geopolars
-
Rust 1.63.0
Oh, that’s really cool. Rust noob here, and I hadn't seen the tooling for building Python bindings. That looks like it could be a very powerful way to speed up your Python programs (much easier than the “just replace the slow bits in C” advice that was standard.)
The mappings in https://github.com/kylebarron/geopolars/blob/master/py-geopo... for example look very easy to follow.
polars
-
Why Python's Integer Division Floors (2010)
This is because 0.1 is in actuality the floating point value value 0.1000000000000000055511151231257827021181583404541015625, and thus 1 divided by it is ever so slightly smaller than 10. Nevertheless, fpround(1 / fpround(1 / 10)) = 10 exactly.
I found out about this recently because in Polars I defined a // b for floats to be (a / b).floor(), which does return 10 for this computation. Since Python's correctly-rounded division is rather expensive, I chose to stick to this (more context: https://github.com/pola-rs/polars/issues/14596#issuecomment-...).
-
Polars
https://github.com/pola-rs/polars/releases/tag/py-0.19.0
-
Stuff I Learned during Hanukkah of Data 2023
That turned out to be related to pola-rs/polars#11912, and this linked comment provided a deceptively simple solution - use PARSE_DECLTYPES when creating the connection:
- Polars 0.20 Released
- Segunda linguagem
- Polars: Dataframes powered by a multithreaded query engine, written in Rust
- Summing columns in remote Parquet files using DuckDB
- Polars 0.34 is released. (A query engine focussing on DataFrame front ends)
What are some alternatives?
dply-rs - A dataframe manipulation tool for parquet, csv, and json data.
vaex - Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second 🚀
parquet-wasm - Rust-based WebAssembly bindings to read and write Apache Parquet data
modin - Modin: Scale your Pandas workflows by changing a single line of code
transmitic - Encrypted, peer to peer, file transfer program :: https://discord.gg/tRT3J6T :: https://www.reddit.com/r/transmitic/ :: https://twitter.com/transmitic
datafusion - Apache DataFusion SQL Query Engine
zero-to-production - Code for "Zero To Production In Rust", a book on API development using Rust.
DataFrames.jl - In-memory tabular data in Julia
datasette-stripe - A web SQL interface to your Stripe account using Datasette.
datatable - A Python package for manipulating 2-dimensional tabular data structures
tokio-scoped - Scoped Runtime for tokio
Apache Arrow - Apache Arrow is a multi-language toolbox for accelerated data interchange and in-memory processing