Rust Onnx

Open-source Rust projects categorized as Onnx

Top 12 Rust Onnx Projects

  1. burn

    Burn is a new comprehensive dynamic Deep Learning Framework built using Rust with extreme flexibility, compute efficiency and portability as its primary goals.

    Project mention: Burn v0.17: Deep Learning in Rust gets new back ends and improved kernel fusion | news.ycombinator.com | 2025-04-23
  2. CodeRabbit

    CodeRabbit: AI Code Reviews for Developers. Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.

    CodeRabbit logo
  3. tract

    Tiny, no-nonsense, self-contained, Tensorflow and ONNX inference

  4. wonnx

    A WebGPU-accelerated ONNX inference run-time written 100% in Rust, ready for native and the web

  5. ort

    Fast ML inference & training for ONNX models in Rust (by pykeio)

  6. EmbedAnything

    Production-ready Inference, Ingestion and Indexing built in Rust 🦀

    Project mention: Optimize VLM Tokens with EmbedAnything x ColPali | dev.to | 2025-01-12

    However, due to its computational demands, running the ColPali model directly on a local machine might not always be feasible. To address this, I developed a onnx version of ColPali which can be quantized to different precisions. Quantization reduces the precision of the model's weights, significantly lowering computational and memory requirements. Despite this optimization, the quantized model maintains performance nearly equivalent to the original. In this article we will look at how to use ColPali for Vision RAG by using the EmbedAnything library that I have been developing for the last few months. You can read more about EmbedAnything here

  7. blindai

    Confidential AI deployment with secure enclaves :lock:

  8. rust-mlops-template

    A work in progress to build out solutions in Rust for MLOPs

  9. InfluxDB

    InfluxDB high-performance time series database. Collect, organize, and act on massive volumes of high-resolution data to power real-time intelligent systems.

    InfluxDB logo
  10. onnxruntime-rs

    Rust wrapper for Microsoft's ONNX Runtime (version 1.8)

  11. altius

    Small ONNX inference runtime written in Rust

  12. tractjs

    Run ONNX and TensorFlow inference in the browser.

  13. steelix

    Your one stop CLI for ONNX model analysis.

  14. yolov5-api-rust

    Rust API to run predictions with YoloV5 models.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Rust Onnx discussion

Log in or Post with

Rust Onnx related posts

  • Small inference runtime for deep neural networks

    1 project | news.ycombinator.com | 23 Jul 2023
  • Are there any ML crates that would compile to WASM?

    3 projects | /r/rust | 3 Jul 2023
  • WebGPU ONNX inference runtime written in Rust

    1 project | news.ycombinator.com | 23 May 2023
  • rustformers/llm: Run inference for Large Language Models on CPU, with Rust 🦀🚀🦙

    4 projects | /r/rust | 10 May 2023
  • tract VS burn - a user suggested alternative

    2 projects | 25 Mar 2023
  • onnxruntime

    4 projects | /r/rust | 22 Feb 2023
  • Steelix - CLI for ONNX model analysis

    1 project | /r/deeplearning | 3 Nov 2022
  • A note from our sponsor - SaaSHub
    www.saashub.com | 23 Apr 2025
    SaaSHub helps you find the best software and product alternatives Learn more →

Index

What are some of the best open-source Onnx projects in Rust? This list will help you:

# Project Stars
1 burn 10,308
2 tract 2,403
3 wonnx 1,726
4 ort 1,266
5 EmbedAnything 520
6 blindai 505
7 rust-mlops-template 347
8 onnxruntime-rs 287
9 altius 97
10 tractjs 75
11 steelix 47
12 yolov5-api-rust 28

Sponsored
CodeRabbit: AI Code Reviews for Developers
Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.
coderabbit.ai

Did you know that Rust is
the 5th most popular programming language
based on number of references?