pydantic-core
polars
Our great sponsors
| pydantic-core | polars | |
|---|---|---|
| 18 | 144 | |
| 1,263 | 25,837 | |
| 2.5% | 5.3% | |
| 9.6 | 10.0 | |
| 1 day ago | 6 days ago | |
| Python | Rust | |
| MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
pydantic-core
-
Is there a pydantic.BaseSettings equivalent in rust?
Funny that you ask... https://github.com/pydantic/pydantic-core Unfortunately it seems that the functionality you ask for is not (yet) part of this ...
-
Investigating Pydantic v2's Bold Performance Claims
I encourage you to checkout the official benchmarks for more realistic and detailed examples, and, as always, YMMV.
-
Pydantic V2 leverages Rust's Superpowers [video]
> to also be constrained by a separate set of data types which are legal in rust.
This isn't really how writing rust/python iterop works. You tend to have opaque handles you call python methods on. Here's a decent example I found skimming the code.
https://github.com/pydantic/pydantic-core/blob/main/src/inpu...
-
Pydantic vs Protobuf vs Namedtuples vs Dataclasses
Thanks for pointing out to that, I did not know about it. Also attaching repo in case someone would be interested as well - https://github.com/pydantic/pydantic-core
-
Introducing CodSpeed: Continuous Performance Measurement
pydantic-core: The core validation logic for pydantic, a Python data parsing and validation library.
-
Show HN: Python framework is faster than Golang Fiber
pydandic-core [0] will hopefully solve this issue (written in Rust)
- Scala or Rust? which one will rule in future?
-
Rust for Data Engineering—what's the hype about? 🦀
LinkedIn influencers are weird lol. Rust v Python is apples and oranges. Rust would be glued together by python just like it does with C/C++ and Java/Spark today. We’re already seeing some packages go this direction, like pydantic v2 is rewriting its core validation in rust.
- Python file structure with Rust extensions
- Pydantic 2 rewritten in Rust was merged
polars
-
Why Python's Integer Division Floors (2010)
This is because 0.1 is in actuality the floating point value value 0.1000000000000000055511151231257827021181583404541015625, and thus 1 divided by it is ever so slightly smaller than 10. Nevertheless, fpround(1 / fpround(1 / 10)) = 10 exactly.
I found out about this recently because in Polars I defined a // b for floats to be (a / b).floor(), which does return 10 for this computation. Since Python's correctly-rounded division is rather expensive, I chose to stick to this (more context: https://github.com/pola-rs/polars/issues/14596#issuecomment-...).
- Polars
-
Stuff I Learned during Hanukkah of Data 2023
That turned out to be related to pola-rs/polars#11912, and this linked comment provided a deceptively simple solution - use PARSE_DECLTYPES when creating the connection:
- Polars 0.20 Released
- Segunda linguagem
- Polars: Dataframes powered by a multithreaded query engine, written in Rust
- Summing columns in remote Parquet files using DuckDB
- Polars 0.34 is released. (A query engine focussing on DataFrame front ends)
What are some alternatives?
aiohttp-apispec - Build and document REST APIs with aiohttp and apispec
vaex - Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second 🚀
msgspec - A fast serialization and validation library, with builtin support for JSON, MessagePack, YAML, and TOML
modin - Modin: Scale your Pandas workflows by changing a single line of code
pymartini - A Cython port of Martini for fast RTIN terrain mesh generation
arrow-datafusion - Apache DataFusion SQL Query Engine
koda-validate - Typesafe, Composable Validation
DataFrames.jl - In-memory tabular data in Julia
typedload - Python library to load dynamically typed data into statically typed data structures
datatable - A Python package for manipulating 2-dimensional tabular data structures
Apache Arrow - Apache Arrow is a multi-language toolbox for accelerated data interchange and in-memory processing