tract
Tiny, no-nonsense, self-contained, Tensorflow and ONNX inference (by sonos)
onnxruntime-rs
Rust wrapper for Microsoft's ONNX Runtime (version 1.8) (by nbigaouette)
| tract | onnxruntime-rs | |
|---|---|---|
| 20 | 2 | |
| 2,370 | 287 | |
| 3.0% | 0.7% | |
| 9.9 | 0.0 | |
| 1 day ago | about 1 year ago | |
| Rust | Rust | |
| Apache 2.0/MIT | Apache License 2.0 |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
tract
Posts with mentions or reviews of tract.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-07-03.
-
Are there any ML crates that would compile to WASM?
Tract is the most well known ML crate in Rust, which I believe can compile to WASM - https://github.com/sonos/tract/. Burn may also be useful - https://github.com/burn-rs/burn.
-
[Discussion] What crates would you like to see?
tract!!
-
tract VS burn - a user suggested alternative
2 projects | 25 Mar 2023
-
Machine Learning Inference Server in Rust?
we use tract for inference, integrated into our runtime and services.
- onnxruntime
- Rust Native ML Frameworks?
-
Neural networks - what crates to use?
Not for training, but for inference this looks nice: https://github.com/sonos/tract
-
Brain.js: GPU Accelerated Neural Networks in JavaScript
There's also tract, from sonos[0]. 100% rust.
I'm currently trying to use it to do speech recognition with a variant of the Conformer architecture (exported to ONNX).
The final goal is to do it in WASM client-side.
[0] https://github.com/sonos/tract
-
Serving ML at the Speed of Rust
As the article notes, there isn't any official Rust-native support for any common frameworks.
tract (https://github.com/sonos/tract) seems like the most mature for ONNX (for which TF/PT export is good nowadays), and recently it successfully implemented BERT.
-
Run deep neural network models from scratch
There are some DL libraries written in Rust: https://github.com/sonos/tract , https://docs.rs/neuronika/latest/neuronika/index.html . The second one could be used for training, I think.
onnxruntime-rs
Posts with mentions or reviews of onnxruntime-rs.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2021-04-29.
-
Deep Learning in Rust on GPU with onnxruntime-rs
I did: https://github.com/nbigaouette/onnxruntime-rs/pull/87 but the maintainer seems to be off. I sent an email.
-
Interesting results comparing TF and Rust
I have used the https://github.com/nbigaouette/onnxruntime-rs ONNX C++ wrapper on a Pytorch model, and did not see any difference in compute time between ONNX Python and ONNX Rust for GPU.
What are some alternatives?
When comparing tract and onnxruntime-rs you can also consider the following projects:
wonnx - A WebGPU-accelerated ONNX inference run-time written 100% in Rust, ready for native and the web
rust-gpu - 🐉 Making Rust a first-class language and ecosystem for GPU shaders 🚧
tractjs - Run ONNX and TensorFlow inference in the browser.
ort - Fast ML inference & training for ONNX models in Rust
linfa - A Rust machine learning framework.