Managing outdated pull requests is time-consuming. Mergify's Merge Queue automates your pull request management & merging. It's fully integrated to GitHub & coordinated with any CI. Start focusing on code. Try Mergify for free. Learn more →
Top 15 Rust Deep Learning Projects
-
Project mention: Why Rust Is the Optimal Choice for Deep Learning, and How to Start Your Journey with the Burn Deep Learning Framework | dev.to | 2023-09-07
The comprehensive, open-source deep learning framework in Rust, Burn, has recently undergone significant advancements in its latest release, highlighted by the addition of The Burn Book 🔥. There has never been a better moment to embark on your deep learning journey with Rust, as this book will guide you through your initial project, providing extensive explanations and links to relevant resources.
-
Project mention: Llama2.rs: One-file Rust implementation of Llama2 | news.ycombinator.com | 2023-08-05
I wanted to do something like this but then I would miss on proper CUDA acceleration and lose performance compared to using torchlib.
I wrote a forgettable llama implementation for https://github.com/LaurentMazare/tch-rs (pytorch's torchlib rust binding).
-
SonarLint
Clean code begins in your IDE with SonarLint. Up your coding game and discover issues early. SonarLint is a free plugin that helps you find & fix bugs and security issues from the moment you start writing code. Install from your favorite IDE marketplace today.
-
lance
Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, with more integrations coming..
-
rust-bert
Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)
Project mention: How to leverage the state-of-the-art NLP models in Rust | /r/infinilabs | 2023-06-07brew install libtorch brew link libtorch brew ls --verbose libtorch | grep dylib export LIBTORCH=$(brew --cellar pytorch)/$(brew info --json pytorch | jq -r '.[0].installed[0].version') export LD_LIBRARY_PATH=${LIBTORCH}/lib:$LD_LIBRARY_PATH git clone https://github.com/guillaume-be/rust-bert.git cd rust-bert ORT_STRATEGY=system cargo run --example sentence_embeddings
-
I keep checking the progress on dfdx for this reason. It does what I (and, I assume from context, you) want: Provides static checking of tensor shapes. Which is fantastic. Not quite as much inference as I'd like but I love getting compile-time errors that I forgot to transpose before a matmul.
It depends on the generic_const_exprs feature which is still, to quote, "highly experimental":
https://github.com/rust-lang/rust/issues/76560
Definitely not for production use, but it gives a flavor for where things can head in the medium term, and it's .. it's nice. You could imagine future type support allowing even more inference for some intermediate shapes, of course, but even what it has now is really nice. Like this cute little convnet example:
https://github.com/coreylowman/dfdx/blob/main/examples/night...
-
-
PERSIA
High performance distributed framework for training deep learning recommendation models based on PyTorch.
-
Mergify
Tired of breaking your main and manually rebasing outdated pull requests?. Managing outdated pull requests is time-consuming. Mergify's Merge Queue automates your pull request management & merging. It's fully integrated to GitHub & coordinated with any CI. Start focusing on code. Try Mergify for free.
-
Project mention: BastionLab: A privacy-by-design DataFrame library | news.ycombinator.com | 2023-02-20
-
Project mention: Deep Learning in Rust with my own framework focusing on ergonomics | dev.to | 2023-07-10
With jiro-nn just rely on auto-complete and keep your sanity while following this King County houses sales regression workflow example using a Deep Neural Network:
-
corgi
A neural network, and tensor dynamic automatic differentiation implementation for Rust. (by patricksongzy)
-
Project mention: ByteDetective (first rust project | feedback appreciated) - MacOS Tauri app that let you search for images on your computer by describing them | /r/rust | 2023-07-14
-
-
spacepile
convert reads from repeated measures of same piece of DNA into spaced matricies for deep learners.
Project mention: dna_parser : A Python package written in Rust to encode DNA sequences for machine learning. | /r/rust | 2023-05-17I know very little about machine learning encoding but saw a somewhat similar project here https://github.com/brentp/spacepile
-
modelbox
An extensible machine learning model store and model transformation and distribution service
I am building modelbox right now - https://github.com/tensorland/modelbox I began building this in Rust while also learning the language. It became quickly very complex as I started introducing streams in async traits. I think in a few years things will get a lot better as more people use Rust for building web services, but I had to go back to Go to be more productive and ship this thing out. I loved how the compiler was forcing me to think harder about life times and such.
-
Project mention: [R] Seeking Comprehensive Tutorials on "Under-the-Hood" Machine Learning Concepts | /r/MachineLearning | 2023-06-28
-
InfluxDB
Collect and Analyze Billions of Data Points in Real Time. Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.
Rust Deep Learning related posts
- Why Rust Is the Optimal Choice for Deep Learning, and How to Start Your Journey with the Burn Deep Learning Framework
- Candle: Torch Replacement in Rust
- Burn – A Flexible and Comprehensive Deep Learning Framework in Rust
- Llama2.rs: One-file Rust implementation of Llama2
- Announcing Burn-Wgpu: New Deep Learning Cross-Platform GPU Backend
- [D] MNIST-like dataset in SVG format
- [N] Open-source search engine Meilisearch launches vector search
-
A note from our sponsor - Mergify
blog.mergify.com | 23 Sep 2023
Index
What are some of the best open-source Deep Learning projects in Rust? This list will help you:
Project | Stars | |
---|---|---|
1 | burn | 3,599 |
2 | tch-rs | 3,255 |
3 | lance | 2,638 |
4 | rust-bert | 2,101 |
5 | dfdx | 1,342 |
6 | gamma | 380 |
7 | PERSIA | 365 |
8 | bastionlab | 157 |
9 | jiro-nn | 114 |
10 | corgi | 22 |
11 | ByteDetective | 18 |
12 | batched-fn | 14 |
13 | spacepile | 12 |
14 | modelbox | 12 |
15 | autograd-rs | 1 |