InfluxDB is the Time Series Platform where developers build real-time applications for analytics, IoT and cloud-native services. Easy to start, it is available in the cloud or on-premises. Learn more →
Top 5 Rust Data processing Projects
-
rust-ndarray
ndarray: an N-dimensional array with array views, multidimensional slicing, and efficient operations
Project mention: How does explicit unrolling differ from iterating through elements one-by-one? (ndarray example) | reddit.com/r/rust | 2023-01-13While looking through ndarrays src, I came across a set of functions that explicitly unroll 8 variables on each iteration of a loop, with the comment eightfold unrolled so that floating point can be vectorized (even with strict floating point accuracy semantics). I don't understand why floats would be affected by unrolling, and in general I'm confused as to how explicit unrolling differs from iterating through each element one by one. I assumed this would be a scenario where the compiler would optimize best anyway, which seems to be confirmed (at least in the context of using iter() rather than for) here. Could anyone give a little context into what this, or any explicit unrolling achieves?
-
Project mention: “Streaming” data processing using asynchronous generators in python | reddit.com/r/dataengineering | 2023-02-04
This the approach used for streaming data with bytewax. Some examples on the GitHub repo.
-
SonarQube
Static code analysis for 29 languages.. Your projects are multi-language. So is SonarQube analysis. Find Bugs, Vulnerabilities, Security Hotspots, and Code Smells so you can release quality code every time. Get started analyzing your projects today for free.
-
Project mention: What features would you want in a new programming language? | reddit.com/r/ProgrammingLanguages | 2023-01-03
You should take a look at the language I’m developing, Mech: https://github.com/mech-lang/mech
-
-
ux-dataflow
UX-Dataflow is a streaming capable data multiplexer that allows you to aggregate data and then process it using a Chain of Responsibility design pattern.
-
InfluxDB
Build time-series-based applications quickly and at scale.. InfluxDB is the Time Series Platform where developers build real-time applications for analytics, IoT and cloud-native services. Easy to start, it is available in the cloud or on-premises.
Rust Data processing related posts
- How does explicit unrolling differ from iterating through elements one-by-one? (ndarray example)
- How do you think of concurrency and parallelism and what would your dream syntax be for it?
- Pure rust implementation for deep learning models
- Any efficient way of splitting vector?
- Help slicing 2D array in no_std environment
- Mech Lang Spring Update: On the Road Toward Beta!
- Enzyme: Towards state-of-the-art AutoDiff in Rust
-
A note from our sponsor - InfluxDB
www.influxdata.com | 8 Feb 2023
Index
What are some of the best open-source Data processing projects in Rust? This list will help you:
Project | Stars | |
---|---|---|
1 | rust-ndarray | 2,594 |
2 | bytewax | 323 |
3 | mech | 176 |
4 | utah | 137 |
5 | ux-dataflow | 7 |