|6 days ago||6 days ago|
|Mozilla Public License 2.0||MIT License|
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
What sort of mature, open-source libraries do you feel Rust should have but currently lacks?
22 projects | reddit.com/r/rust | 1 Nov 2021
If you like autograd you will love neuronika
bhtsne 0.5.0, now 5.6x faster on a 4 core machine, plus a summary of my Rust journey (so far)
2 projects | reddit.com/r/rust | 15 Oct 2021
After reading most of the book, I wanted to get my hands dirty. My initial idea was to build a small machine learning framework but I deemed it to be too difficult if not impossible for me at the time. (Now, neuronika would have something to say). When gathering the bibliography for my thesis, I recalled to have stumbled upon a particular algorithm, t-SNE, whom I liked very much. I found the idea behind it to be very clever and elegant (t-SNE it's still one of my favorite algorithms, together with backprop and SOM, I find manifold learning fascinating in general). "So be it", I said, and I began writing a mess of a code, that was basically a translation of the C++ implementation. Boy was it bad.
What are you using Rust for?
22 projects | reddit.com/r/rust | 1 Oct 2021
me and a colleague of mine are developing neuronika22 projects | reddit.com/r/rust | 1 Oct 2021
Nobody has the audacity to really push forward this statement, at least not in scientific computing, that I know of. Personally, the lack of somewhat stable GPU computing and some key features of Rust, which are still unstable are slowing the development of neuronika.
How can one make Rust excel in the Sciences
3 projects | reddit.com/r/rust | 26 Sep 2021
neuronika provides some paddings and convolutions, as well as auto differentiation an other neural building blocks.
What's everyone working on this week (37/2021)?
8 projects | reddit.com/r/rust | 13 Sep 2021
Improving the convolution code on neuronika.
Are there any good gpu linear algebra crates?
4 projects | reddit.com/r/rust | 10 Sep 2021
Interesting! I'm also working on an autograd framework based on ndarray, it would be cool, if you are interested or have time, to try and experiment with GPUs!
I wanted to share my experience of Rust as a deep learning researcher
8 projects | reddit.com/r/rust | 1 Sep 2021
You can take a look at neuronika which is a fairly young machine pytorch-style learning framework in pure Rust. It's current being developed by a collegue of mine and me.
Announcing neuronika 0.1.0, a deep learning framework in Rust
7 projects | reddit.com/r/rust | 15 Jun 2021
Neuronika was developed by a colleague of mine and me for a university project. ( we are master's students in CS). The framework offers auto-differentiation and dynamic neural networks, pretty much like Pytorch does.
Neuronika: A machine learning framework written in rust
1 project | news.ycombinator.com | 15 Jun 2021
Rust and what it needs to gain space in computation-oriented applications
7 projects | reddit.com/r/rust | 24 Nov 2021
You should check out polars, datafusion, influxdb iox and databend, all written in native Rust and powered by the Apache Arrow format. Polars in particular is pretty dam fast and has bindings for Python.
How to pass dataframes between Rust and Python?
A solution for either Polars or Datafusion (or something else?) would be fine. For both libraries, python packages exist, that contain the python bindings: https://github.com/pola-rs/polars/tree/master/py-polars https://github.com/apache/arrow-datafusion/tree/master/python
It's working for me now. :-) To get it working, I used the code from the suggested directory as well as the class PyPolarsError, which I copied into a local module: https://github.com/pola-rs/polars/tree/master/py-polars/src/arrow_interop https://github.com/pola-rs/polars/blob/629f5012bcefaa3c9a9c1a236e64dc057e8d472c/py-polars/src/error.rs Besides the polars dependency, also these are needed:
Introducing tidypolars - a Python data frame package with syntax familiar to R tidyverse users
4 projects | reddit.com/r/datascience | 10 Nov 2021
The biggest difference with this one is that it's built on top of the polars package, which is probably the fastest data frame manipulation library out there. All of the other dplyr-to-python packages are build on top of pandas (which is very slow in comparison).
Introducing tidypolars - a Python data frame package for R tidyverse users
9 projects | reddit.com/r/rstats | 10 Nov 2021
tidypolars uses the polars package as a backend, which might be the fastest data frame manipulation library out there. (Faster even than R's data.table, which has been the king of speed for many years.)9 projects | reddit.com/r/rstats | 10 Nov 2021
Python and ETL
3 projects | reddit.com/r/dataengineering | 5 Nov 2021
Shameless plug. But I genuinely believe polars is the best tool for the job if performance, schema validity and RAM usage is important to you. Dependent on your machine Its performance is 2x-70x times pandas. It uses arrow memory and thus has proper null handling, has query optimization, a lot of parallelization, insanely fast csv-parser and utilizes much less RAM then pandas.
Show HN: Dataframes in Elixir Backed by Rust
6 projects | news.ycombinator.com | 4 Nov 2021
Discussion: Integrating polars and plotters
2 projects | reddit.com/r/rust | 26 Oct 2021
For those who do not know about them, polars is a data frame crate for Rust and Python. It is also the fastest data frame library, according to benchmarks. Plotters is a crate for data visualisation. Both are the equivalents of pandas and matplotlib from the Python ecosystem. However, the integration with matplotlib in pandas has no equivalent. I would like to propose an effort to integrate polars with plotters, either by modifying the existing codebases, or creating a new bridge crate. I would love to hear opinions about this from the widder community.
What are some alternatives?
Apache Arrow - Apache Arrow is a multi-language toolbox for accelerated data interchange and in-memory processing
vaex - Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualize and explore big tabular data at a billion rows per second 🚀
rust-ndarray - ndarray: an N-dimensional array with array views, multidimensional slicing, and efficient operations
arrow-rs - Official Rust implementation of Apache Arrow
wgpu - Safe and portable GPU abstraction in Rust, implementing WebGPU API.
db-benchmark - reproducible benchmark of database-like ops
rust-csv - A CSV parser for Rust, with Serde support.
rustdesk - Yet another remote desktop software
arrow2 - Unofficial transmute-free Rust library to work with the Arrow format
tokio-tungstenite - Tokio binding for Tungstenite, the Lightweight stream-based WebSocket implementation
are-we-learning-yet - How ready is Rust for Machine Learning?