Top 12 Rust Onnx Projects

Onnx

• Add a project

1. burn

   1 12 10,308 9.8 Rust

   Burn is a new comprehensive dynamic Deep Learning Framework built using Rust with extreme flexibility, compute efficiency and portability as its primary goals.

   

   Project mention: Burn v0.17: Deep Learning in Rust gets new back ends and improved kernel fusion | news.ycombinator.com | 2025-04-23

2. CodeRabbit

   coderabbit.ai featured

   CodeRabbit: AI Code Reviews for Developers. Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.

   

3. tract

   2 20 2,403 9.9 Rust

   Tiny, no-nonsense, self-contained, Tensorflow and ONNX inference

   

4. wonnx

   3 18 1,726 5.7 Rust

   A WebGPU-accelerated ONNX inference run-time written 100% in Rust, ready for native and the web

   

5. ort

   4 7 1,266 9.6 Rust

   Fast ML inference & training for ONNX models in Rust (by pykeio)

   

6. EmbedAnything

   5 7 520 9.7 Rust

   Production-ready Inference, Ingestion and Indexing built in Rust 🦀

   

   Project mention: Optimize VLM Tokens with EmbedAnything x ColPali | dev.to | 2025-01-12

   However, due to its computational demands, running the ColPali model directly on a local machine might not always be feasible. To address this, I developed a onnx version of ColPali which can be quantized to different precisions. Quantization reduces the precision of the model's weights, significantly lowering computational and memory requirements. Despite this optimization, the quantized model maintains performance nearly equivalent to the original. In this article we will look at how to use ColPali for Vision RAG by using the EmbedAnything library that I have been developing for the last few months. You can read more about EmbedAnything here

7. blindai

   6 6 505 8.0 Rust

   Confidential AI deployment with secure enclaves :lock:

   

8. rust-mlops-template

   7 2 347 2.2 Rust

   A work in progress to build out solutions in Rust for MLOPs

   

9. InfluxDB

   influxdata.com featured

   InfluxDB high-performance time series database. Collect, organize, and act on massive volumes of high-resolution data to power real-time intelligent systems.

   

10. onnxruntime-rs

    8 2 287 0.0 Rust

    Rust wrapper for Microsoft's ONNX Runtime (version 1.8)

    

11. altius

    9 3 97 7.9 Rust

    Small ONNX inference runtime written in Rust

    

12. tractjs

    10 1 75 0.0 Rust

    Run ONNX and TensorFlow inference in the browser.

    

13. steelix

    11 2 47 10.0 Rust

    Your one stop CLI for ONNX model analysis.

    

14. yolov5-api-rust

    12 1 28 10.0 Rust

    Rust API to run predictions with YoloV5 models.

    

Rust Onnx related posts

• Small inference runtime for deep neural networks

  1 project | news.ycombinator.com | 23 Jul 2023

• Are there any ML crates that would compile to WASM?

  3 projects | /r/rust | 3 Jul 2023

• WebGPU ONNX inference runtime written in Rust

  1 project | news.ycombinator.com | 23 May 2023

• rustformers/llm: Run inference for Large Language Models on CPU, with Rust 🦀🚀🦙

  4 projects | /r/rust | 10 May 2023

• tract VS burn - a user suggested alternative

  2 projects | 25 Mar 2023

• onnxruntime

  4 projects | /r/rust | 22 Feb 2023

• Steelix - CLI for ONNX model analysis

  1 project | /r/deeplearning | 3 Nov 2022
• A note from our sponsor - SaaSHub
  www.saashub.com | 23 Apr 2025

  SaaSHub helps you find the best software and product alternatives Learn more →

Index

Sponsored

CodeRabbit: AI Code Reviews for Developers

Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.

coderabbit.ai

Do not miss the trending Rust projects with our weekly report!