Candle: Torch Replacement in Rust

1. candle

   1 19 16,814 9.5 Rust

   Minimalist ML framework for Rust

   

   I sense that most folks will end up using this via a Python wrapper, much like how HF has Transformers written in Rust but with a Python wrapper.

   This library is targeting production, a much smaller subset of engineers. See the 'why candle' section: https://github.com/huggingface/candle#why-candle

2. CodeRabbit

   coderabbit.ai featured

   CodeRabbit: AI Code Reviews for Developers. Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.

   

3. syntaxdot

   2 4 72 6.2 Rust

   Neural syntax annotator, supporting sequence labeling, lemmatization, and dependency parsing.

   

   I am so happy about them releasing this. A few years ago I wrote a multi-task syntax annotator in Rust using Laurent Mazare's excellent tch-rs binding (it seems like he is also working on Candle):

   https://github.com/tensordot/syntaxdot

   However, the deployment story was always quite difficult. The PyTorch C++ API is not stable, so a particular version of tch-rs will only work with a particular PyTorch version. So, anyone wanting to use SyntaxDot always had to get exactly the right version of libtorch (and set some environment variables) to build the project.

   The idea of making an abstraction over Torch and Rust ndarray (similar to Burn) crossed my mind several times, but there is only so much that I could do as a solo developer. So Candle would be a god-given if I was still working on this project.

   Seeing Candle wants to make me port curated-transformers to Candle for fun:

   https://github.com/explosion/curated-transformers

4. llama2.rs

   3 3 1,034 8.9 Rust

   A fast llama2 decoder in pure Rust.

   

   Nowhere near as neat as candle or ggml, but just released a 4-bit rust llama2 implementation with simd. Runs pretty fast.

   https://github.com/srush/llama2.rs/

5. rust-gpu

   4 83 7,426 5.4 Rust

   🐉 Making Rust a first-class language and ecosystem for GPU shaders 🚧

   

   I don't do anything related to data science, but I feel like doing it in Rust would be nice.

   You get operator overloading, so you can have ergonomic matrix operations that are typed also. Processing data on the CPU is fast, and crates like https://github.com/EmbarkStudios/rust-gpu make it very ergonomic to leverage the GPU.

   I like this library for creating typed coordinate spaces for graphics programming (https://github.com/servo/euclid), I imagine something similar could be done to create refined types for matrices so you don't do matrix multiplication matrices of invalid sizes

6. euclid

   5 1 466 5.5 Rust

   Geometry primitives (basic linear algebra) for Rust

   

   I don't do anything related to data science, but I feel like doing it in Rust would be nice.

   You get operator overloading, so you can have ergonomic matrix operations that are typed also. Processing data on the CPU is fast, and crates like https://github.com/EmbarkStudios/rust-gpu make it very ergonomic to leverage the GPU.

   I like this library for creating typed coordinate spaces for graphics programming (https://github.com/servo/euclid), I imagine something similar could be done to create refined types for matrices so you don't do matrix multiplication matrices of invalid sizes

7. rust

   6 2,801 102,063 10.0 Rust

   Empowering everyone to build reliable and efficient software.

   

   I keep checking the progress on dfdx for this reason. It does what I (and, I assume from context, you) want: Provides static checking of tensor shapes. Which is fantastic. Not quite as much inference as I'd like but I love getting compile-time errors that I forgot to transpose before a matmul.

   It depends on the generic_const_exprs feature which is still, to quote, "highly experimental":

   https://github.com/rust-lang/rust/issues/76560

   Definitely not for production use, but it gives a flavor for where things can head in the medium term, and it's .. it's nice. You could imagine future type support allowing even more inference for some intermediate shapes, of course, but even what it has now is really nice. Like this cute little convnet example:

   https://github.com/coreylowman/dfdx/blob/main/examples/night...

8. dfdx

   7 22 1,790 5.8 Rust

   Deep learning in Rust, with shape checked tensors and neural networks

   

   I keep checking the progress on dfdx for this reason. It does what I (and, I assume from context, you) want: Provides static checking of tensor shapes. Which is fantastic. Not quite as much inference as I'd like but I love getting compile-time errors that I forgot to transpose before a matmul.

   It depends on the generic_const_exprs feature which is still, to quote, "highly experimental":

   https://github.com/rust-lang/rust/issues/76560

   Definitely not for production use, but it gives a flavor for where things can head in the medium term, and it's .. it's nice. You could imagine future type support allowing even more inference for some intermediate shapes, of course, but even what it has now is really nice. Like this cute little convnet example:

   https://github.com/coreylowman/dfdx/blob/main/examples/night...

9. SaaSHub

   www.saashub.com featured

   SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

   

10. burn

    8 34 4,845 8.9 Rust

    Discontinued Burn is a new comprehensive dynamic Deep Learning Framework built using Rust with extreme flexibility, compute efficiency and portability as its primary goals. [Moved to: https://github.com/Tracel-AI/burn] (by burn-rs)

    

    Burn (deep learning framework in rust) has WGPU backend (WebGPU) already. Check it out https://github.com/burn-rs/burn. It was released recently.

Suggest a related project