fluvio
polars
fluvio | polars | |
---|---|---|
26 | 144 | |
2,663 | 26,378 | |
3.1% | 3.4% | |
9.5 | 10.0 | |
3 days ago | about 19 hours ago | |
Rust | Rust | |
Apache License 2.0 | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
fluvio
- Ask HN: WebSocket Relay?
- XFaaS: Hyperscale and Low Cost Serverless Functions at Meta
-
Iggy.rs – building message streaming in Rust
I'm not quite sure how this compares to Kafka and fluvio [1], a Kafka competitor also written in Rust?
Is it more of a message queue like rabbitmq?
[1] https://www.fluvio.io/
- Fluvio: Open-source data streaming platform
- Show HN: Fluvio – Distributed stream processing system written in Rust and WASM
-
Thank you for checking out the Fluvio repo
Seeing signs of the hockey stick traffic on the Fluvio Open Source repo: https://github.com/infinyon/fluvio
Stopped the mobile notifications for the stargazer bot on discord and slack to stop the dopamine rush!!!
But thank you for checking us out.
- Opens Source Rust and WASM Alternative to Kafka and Flink
- Fluvio is a high-performance distributed data streaming platform in Rust
- RabbitMQ vs. Kafka – An Architect’s Dilemma (Part 1)
-
Advice: I am 36, and i want to transition from ETL developer to Rust
Look at open source project fluvio https://github.com/infinyon/fluvio and see how we’re building a modern bus that can do ETL streaming style :).
polars
-
Why Python's Integer Division Floors (2010)
This is because 0.1 is in actuality the floating point value value 0.1000000000000000055511151231257827021181583404541015625, and thus 1 divided by it is ever so slightly smaller than 10. Nevertheless, fpround(1 / fpround(1 / 10)) = 10 exactly.
I found out about this recently because in Polars I defined a // b for floats to be (a / b).floor(), which does return 10 for this computation. Since Python's correctly-rounded division is rather expensive, I chose to stick to this (more context: https://github.com/pola-rs/polars/issues/14596#issuecomment-...).
-
Polars
https://github.com/pola-rs/polars/releases/tag/py-0.19.0
-
Stuff I Learned during Hanukkah of Data 2023
That turned out to be related to pola-rs/polars#11912, and this linked comment provided a deceptively simple solution - use PARSE_DECLTYPES when creating the connection:
- Polars 0.20 Released
- Segunda linguagem
- Polars: Dataframes powered by a multithreaded query engine, written in Rust
- Summing columns in remote Parquet files using DuckDB
- Polars 0.34 is released. (A query engine focussing on DataFrame front ends)
What are some alternatives?
nsq - A realtime distributed messaging platform
vaex - Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second 🚀
datafuse - An elastic and reliable Cloud Warehouse, offers Blazing Fast Query and combines Elasticity, Simplicity, Low cost of the Cloud, built to make the Data Cloud easy [Moved to: https://github.com/datafuselabs/databend]
modin - Modin: Scale your Pandas workflows by changing a single line of code
roapi - Create full-fledged APIs for slowly moving datasets without writing a single line of code.
datafusion - Apache DataFusion SQL Query Engine
sccache - Sccache is a ccache-like tool. It is used as a compiler wrapper and avoids compilation when possible. Sccache has the capability to utilize caching in remote storage environments, including various cloud storage options, or alternatively, in local storage.
DataFrames.jl - In-memory tabular data in Julia
rust-blog - Educational blog posts for Rust beginners
datatable - A Python package for manipulating 2-dimensional tabular data structures
cache - Cache dependencies and build outputs in GitHub Actions
Apache Arrow - Apache Arrow is a multi-language toolbox for accelerated data interchange and in-memory processing