Rust polars

Open-source Rust projects categorized as polars

Top 8 Rust polar Projects

  • polars

    Dataframes powered by a multithreaded, vectorized query engine, written in Rust

  • Project mention: Why Python's Integer Division Floors (2010) | news.ycombinator.com | 2024-02-28

    This is because 0.1 is in actuality the floating point value value 0.1000000000000000055511151231257827021181583404541015625, and thus 1 divided by it is ever so slightly smaller than 10. Nevertheless, fpround(1 / fpround(1 / 10)) = 10 exactly.

    I found out about this recently because in Polars I defined a // b for floats to be (a / b).floor(), which does return 10 for this computation. Since Python's correctly-rounded division is rather expensive, I chose to stick to this (more context: https://github.com/pola-rs/polars/issues/14596#issuecomment-...).

  • qsv

    CSVs sliced, diced & analyzed.

  • Project mention: Qsv: Efficient CSV CLI Toolkit | news.ycombinator.com | 2023-12-22

    Thanks for the detailed feedback @snidane!

    As maintainer of qsv, here's my reply:

    - Given qsv's rapid release cycle (173 releases over three years), the auto-update check is essential at the moment. Once we reach 1.0, I'll turn it off. For now, given your feedback, I've only made it check 10% of the time.

    - Pivot is in the backlog and I'll be sure to add unpivot when I implement it. (https://github.com/jqnatividad/qsv/issues/799)

    - I'll add a dedicated summing command with the group by (-by) and window by (-over) capability (https://github.com/jqnatividad/qsv/issues/1514). Do note that `stats` has basic sum as @ezequiel-garzon pointed out.

    - With the `enum` command, qsv can achieve what you proposed with `laminate`. E.g. qsv enum --new-column newcol --constant newconstant mydata.csv --output laminated-data.csv

    - With the cat rowskey command, qsv can already concatenate files with mismatched headers.

    - other file formats. qsv supports parquet, csv, tsv, excel, ods, datapackage, sqlite and more (see https://github.com/jqnatividad/qsv/tree/master#file-formats). Fixed-format though is not supported yet and quite interesting, and have added it to the backlog (https://github.com/jqnatividad/qsv/issues/1515)

    - as to "enable embedding outputs of commands", qsv is composable by design, so you can use standard stdin/stdout redirection/piping techniques to have it work with other CLI tools like jq, awk, etc.

    Finally, just released v0.120.0 that already incorporates the less aggressive self-update check. https://github.com/jqnatividad/qsv/releases/tag/0.120.0

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo
  • geopolars

    Geospatial extensions for Polars

  • rust-mlops-template

    A work in progress to build out solutions in Rust for MLOPs

  • Project mention: Is anyone doing Machine Learning in Rust? | /r/rust | 2023-05-11
  • pyo3-polars

    Pyo3 extensions for polars

  • Project mention: Introducing polars expression plugins for python | /r/Python | 2023-10-26

    See the full examples here: https://github.com/pola-rs/pyo3-polars/tree/main/example/derive_expression

  • s2protocol-rs

    Starcraft 2 Protocol Replay Reader

  • Project mention: New version of s2protocol-rs SC2Replay parsing crate | /r/starcraft2 | 2023-10-06
  • fastexcel

    A Python wrapper around calamine (by ToucanToco)

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • dply-rs

    A dataframe manipulation tool for parquet, csv, and json data.

  • Project mention: A dplyr interpreter powered by Polars | /r/rust | 2023-05-10

    I have added documentation for all supported functions here.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Index

What are some of the best open-source polar projects in Rust? This list will help you:

Project Stars
1 polars 26,043
2 qsv 2,228
3 geopolars 480
4 rust-mlops-template 271
5 pyo3-polars 193
6 s2protocol-rs 102
7 fastexcel 68
8 dply-rs 38

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com