Rust Deep Learning

Open-source Rust projects categorized as Deep Learning
Edit details
Topics: #Machine Learning #Rust #neural-network #Pytorch #Tensor
Tired of breaking your main and manually rebasing outdated pull requests?
Managing outdated pull requests is time-consuming. Mergify's Merge Queue automates your pull request management & merging. It's fully integrated to GitHub & coordinated with any CI. Start focusing on code. Try Mergify for free.
blog.mergify.com
Sponsored

Top 15 Rust Deep Learning Projects

  • burn

    Burn - A Flexible and Comprehensive Deep Learning Framework in Rust

    Project mention: Why Rust Is the Optimal Choice for Deep Learning, and How to Start Your Journey with the Burn Deep Learning Framework | dev.to | 2023-09-07

    The comprehensive, open-source deep learning framework in Rust, Burn, has recently undergone significant advancements in its latest release, highlighted by the addition of The Burn Book 🔥. There has never been a better moment to embark on your deep learning journey with Rust, as this book will guide you through your initial project, providing extensive explanations and links to relevant resources.

  • tch-rs

    Rust bindings for the C++ api of PyTorch.

    Project mention: Llama2.rs: One-file Rust implementation of Llama2 | news.ycombinator.com | 2023-08-05

    I wanted to do something like this but then I would miss on proper CUDA acceleration and lose performance compared to using torchlib.

    I wrote a forgettable llama implementation for https://github.com/LaurentMazare/tch-rs (pytorch's torchlib rust binding).

  • SonarLint

    Clean code begins in your IDE with SonarLint. Up your coding game and discover issues early. SonarLint is a free plugin that helps you find & fix bugs and security issues from the moment you start writing code. Install from your favorite IDE marketplace today.

  • lance

    Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, with more integrations coming..

    Project mention: FLaNK Stack Weekly for 12 June 2023 | dev.to | 2023-06-11

  • rust-bert

    Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)

    Project mention: How to leverage the state-of-the-art NLP models in Rust | /r/infinilabs | 2023-06-07

    brew install libtorch brew link libtorch brew ls --verbose libtorch | grep dylib export LIBTORCH=$(brew --cellar pytorch)/$(brew info --json pytorch | jq -r '.[0].installed[0].version') export LD_LIBRARY_PATH=${LIBTORCH}/lib:$LD_LIBRARY_PATH git clone https://github.com/guillaume-be/rust-bert.git cd rust-bert ORT_STRATEGY=system cargo run --example sentence_embeddings

  • dfdx

    Deep learning in Rust, with shape checked tensors and neural networks

    Project mention: Candle: Torch Replacement in Rust | news.ycombinator.com | 2023-08-08

    I keep checking the progress on dfdx for this reason. It does what I (and, I assume from context, you) want: Provides static checking of tensor shapes. Which is fantastic. Not quite as much inference as I'd like but I love getting compile-time errors that I forgot to transpose before a matmul.

    It depends on the generic_const_exprs feature which is still, to quote, "highly experimental":

    https://github.com/rust-lang/rust/issues/76560

    Definitely not for production use, but it gives a flavor for where things can head in the medium term, and it's .. it's nice. You could imagine future type support allowing even more inference for some intermediate shapes, of course, but even what it has now is really nice. Like this cute little convnet example:

    https://github.com/coreylowman/dfdx/blob/main/examples/night...

  • gamma

    Computational graphs with reverse automatic differentation in the GPU

  • PERSIA

    High performance distributed framework for training deep learning recommendation models based on PyTorch.

  • Mergify

    Tired of breaking your main and manually rebasing outdated pull requests?. Managing outdated pull requests is time-consuming. Mergify's Merge Queue automates your pull request management & merging. It's fully integrated to GitHub & coordinated with any CI. Start focusing on code. Try Mergify for free.

  • bastionlab

    A simple framework for privacy-friendly data science collaboration

    Project mention: BastionLab: A privacy-by-design DataFrame library | news.ycombinator.com | 2023-02-20

  • jiro-nn

    A Deep Learning and preprocessing framework in Rust with support for CPU and GPU.

    Project mention: Deep Learning in Rust with my own framework focusing on ergonomics | dev.to | 2023-07-10

    With jiro-nn just rely on auto-complete and keep your sanity while following this King County houses sales regression workflow example using a Deep Neural Network:

  • corgi

    A neural network, and tensor dynamic automatic differentiation implementation for Rust. (by patricksongzy)

  • ByteDetective

    The easiest way to search for images on your desktop 🔎

    Project mention: ByteDetective (first rust project | feedback appreciated) - MacOS Tauri app that let you search for images on your computer by describing them | /r/rust | 2023-07-14

  • batched-fn

    🦀 Rust server plugin for deploying deep learning models with batched prediction

  • spacepile

    convert reads from repeated measures of same piece of DNA into spaced matricies for deep learners.

    Project mention: dna_parser : A Python package written in Rust to encode DNA sequences for machine learning. | /r/rust | 2023-05-17

    I know very little about machine learning encoding but saw a somewhat similar project here https://github.com/brentp/spacepile

  • modelbox

    An extensible machine learning model store and model transformation and distribution service

    Project mention: Using Rust at a Startup: A Cautionary Tale | news.ycombinator.com | 2022-11-22

    I am building modelbox right now - https://github.com/tensorland/modelbox I began building this in Rust while also learning the language. It became quickly very complex as I started introducing streams in async traits. I think in a few years things will get a lot better as more people use Rust for building web services, but I had to go back to Go to be more productive and ship this thing out. I loved how the compiler was forcing me to think harder about life times and such.

  • autograd-rs

    An autograd implementation in Rust

    Project mention: [R] Seeking Comprehensive Tutorials on "Under-the-Hood" Machine Learning Concepts | /r/MachineLearning | 2023-06-28

  • InfluxDB

    Collect and Analyze Billions of Data Points in Real Time. Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2023-09-07.

Rust Deep Learning related posts

Index

What are some of the best open-source Deep Learning projects in Rust? This list will help you:

Project Stars
1 burn 3,599
2 tch-rs 3,255
3 lance 2,638
4 rust-bert 2,101
5 dfdx 1,342
6 gamma 380
7 PERSIA 365
8 bastionlab 157
9 jiro-nn 114
10 corgi 22
11 ByteDetective 18
12 batched-fn 14
13 spacepile 12
14 modelbox 12
15 autograd-rs 1

Sponsored
Collect and Analyze Billions of Data Points in Real Time
Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.
www.influxdata.com