Rust Onnx

Open-source Rust projects categorized as Onnx

Top 11 Rust Onnx Projects

  • burn

    Burn is a new comprehensive dynamic Deep Learning Framework built using Rust with extreme flexibility, compute efficiency and portability as its primary goals.

    Project mention: 3 years of fulltime Rust game development, and why we're leaving Rust behind | news.ycombinator.com | 2024-04-26

    You can use libtorch directly via `tch-rs`, and at present I'm porting over to Burn (see https://burn.dev) which appears incredibly promising. My impression is it's in a good place, if of course not close to the ecosystem of Python/C++. At very least I've gotten my nn models training and running without too much difficulty. (I'm moving to Burn for the thread safety - their `Tensor` impl is `Sync` - libtorch doesn't have such a guarantee.)

    Burn has Candle as one of its backends, which I understand is also quite popular.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • tract

    Tiny, no-nonsense, self-contained, Tensorflow and ONNX inference

  • wonnx

    A WebGPU-accelerated ONNX inference run-time written 100% in Rust, ready for native and the web

    Project mention: Intel CEO: 'The entire industry is motivated to eliminate the CUDA market' | news.ycombinator.com | 2023-12-14

    The two I know of are IREE and Kompute[1]. I'm not sure how much momentum the latter has, I don't see it referenced much. There's also a growing body of work that uses Vulkan indirectly through WebGPU. This is currently lagging in performance due to lack of subgroups and cooperative matrix mult, but I see that gap closing. There I think wonnx[2] has the most momentum, but I am aware of other efforts.

    [1]: https://kompute.cc/

    [2]: https://github.com/webonnx/wonnx

  • ort

    A Rust wrapper for ONNX Runtime (by pykeio)

    Project mention: AI Inference now available in Supabase Edge Functions | dev.to | 2024-04-16

    To solve this, we built a native extension in Edge Runtime that enables using ONNX runtime via the Rust interface. This was made possible thanks to an excellent Rust wrapper called Ort:

  • blindai

    Confidential AI deployment with secure enclaves :lock:

  • rust-mlops-template

    A work in progress to build out solutions in Rust for MLOPs

  • onnxruntime-rs

    Rust wrapper for Microsoft's ONNX Runtime (version 1.8)

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  • altius

    Small ONNX inference runtime written in Rust

    Project mention: Small inference runtime for deep neural networks | news.ycombinator.com | 2023-07-23
  • tractjs

    Run ONNX and TensorFlow inference in the browser.

  • steelix

    Your one stop CLI for ONNX model analysis.

  • yolov5-api-rust

    Rust API to run predictions with YoloV5 models.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Rust Onnx discussion

Log in or Post with

Rust Onnx related posts

  • Small inference runtime for deep neural networks

    1 project | news.ycombinator.com | 23 Jul 2023
  • Are there any ML crates that would compile to WASM?

    3 projects | /r/rust | 3 Jul 2023
  • WebGPU ONNX inference runtime written in Rust

    1 project | news.ycombinator.com | 23 May 2023
  • rustformers/llm: Run inference for Large Language Models on CPU, with Rust 🦀🚀🦙

    4 projects | /r/rust | 10 May 2023
  • tract VS burn - a user suggested alternative

    2 projects | 25 Mar 2023
  • onnxruntime

    4 projects | /r/rust | 22 Feb 2023
  • Steelix - CLI for ONNX model analysis

    1 project | /r/deeplearning | 3 Nov 2022
  • A note from our sponsor - SaaSHub
    www.saashub.com | 12 Jul 2024
    SaaSHub helps you find the best software and product alternatives Learn more →

Index

What are some of the best open-source Onnx projects in Rust? This list will help you:

Project Stars
1 burn 7,834
2 tract 2,125
3 wonnx 1,547
4 ort 696
5 blindai 498
6 rust-mlops-template 289
7 onnxruntime-rs 265
8 altius 86
9 tractjs 76
10 steelix 43
11 yolov5-api-rust 27

Sponsored
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com

Did you konow that Rust is
the 5th most popular programming language
based on number of metions?