Top 11 Rust Onnx Projects

burn

7 7,020 9.8 Rust

Burn is a new comprehensive dynamic Deep Learning Framework built using Rust with extreme flexibility, compute efficiency and portability as its primary goals.

Project mention: Transitioning From PyTorch to Burn | dev.to | 2024-02-14

[package] name = "resnet_burn" version = "0.1.0" edition = "2021" [dependencies] burn = { git = "https://github.com/tracel-ai/burn.git", rev = "75cb5b6d5633c1c6092cf5046419da75e7f74b11", features = ["ndarray"] } burn-import = { git = "https://github.com/tracel-ai/burn.git", rev = "75cb5b6d5633c1c6092cf5046419da75e7f74b11" } image = { version = "0.24.7", features = ["png", "jpeg"] }

tract

20 2,050 9.8 Rust

Tiny, no-nonsense, self-contained, Tensorflow and ONNX inference

Project mention: Are there any ML crates that would compile to WASM? | /r/rust | 2023-07-03

Tract is the most well known ML crate in Rust, which I believe can compile to WASM - https://github.com/sonos/tract/. Burn may also be useful - https://github.com/burn-rs/burn.

WorkOS

workos.com sponsored

The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
wonnx

18 1,487 6.5 Rust

A WebGPU-accelerated ONNX inference run-time written 100% in Rust, ready for native and the web

Project mention: Intel CEO: 'The entire industry is motivated to eliminate the CUDA market' | news.ycombinator.com | 2023-12-14

The two I know of are IREE and Kompute[1]. I'm not sure how much momentum the latter has, I don't see it referenced much. There's also a growing body of work that uses Vulkan indirectly through WebGPU. This is currently lagging in performance due to lack of subgroups and cooperative matrix mult, but I see that gap closing. There I think wonnx[2] has the most momentum, but I am aware of other efforts.
[1]: https://kompute.cc/
[2]: https://github.com/webonnx/wonnx

ort

7 542 9.3 Rust

A Rust wrapper for ONNX Runtime (by pykeio)

Project mention: AI Inference now available in Supabase Edge Functions | dev.to | 2024-04-16

To solve this, we built a native extension in Edge Runtime that enables using ONNX runtime via the Rust interface. This was made possible thanks to an excellent Rust wrapper called Ort:

blindai

6 489 8.0 Rust

Confidential AI deployment with secure enclaves :lock:
rust-mlops-template

2 271 5.6 Rust

A work in progress to build out solutions in Rust for MLOPs

Project mention: Is anyone doing Machine Learning in Rust? | /r/rust | 2023-05-11

onnxruntime-rs

2 261 0.0 Rust

Rust wrapper for Microsoft's ONNX Runtime (version 1.8)
InfluxDB

www.influxdata.com sponsored

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
altius

3 86 9.0 Rust

Small ONNX inference runtime written in Rust

Project mention: Small inference runtime for deep neural networks | news.ycombinator.com | 2023-07-23

tractjs

1 76 0.0 Rust

Run ONNX and TensorFlow inference in the browser.
steelix

2 36 10.0 Rust

Your one stop CLI for ONNX model analysis.
yolov5-api-rust

1 24 10.0 Rust

Rust API to run predictions with YoloV5 models.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).