Rust Onnx

Open-source Rust projects categorized as Onnx | Edit details

Top 3 Rust Onnx Projects

  • tract

    Tiny, no-nonsense, self-contained, Tensorflow and ONNX inference

    Project mention: BlindAI: fast and privacy-friendly AI deployment solution in Rust | reddit.com/r/rust | 2022-05-19

    I am glad to introduce BlindAI, an AI deployment solution, leveraging secure enclaves, to make remotely hosted AI models privacy friendly. We leverage the tract project as our inference engine to serve AI models in ONNX format inside an enclave. We also use the Rust SGX SDK to use Rust for our secure enclave for AI.

  • onnxruntime-rs

    Rust wrapper for Microsoft's ONNX Runtime (version 1.8)

    Project mention: Deep Learning in Rust on GPU with onnxruntime-rs | reddit.com/r/rust | 2021-07-31

    I did: https://github.com/nbigaouette/onnxruntime-rs/pull/87 but the maintainer seems to be off. I sent an email.

  • Scout APM

    Less time debugging, more time building. Scout APM allows you to find and fix performance issues with no hassle. Now with error monitoring and external services monitoring, Scout is a developer's best friend when it comes to application development.

  • tractjs

    Run ONNX and TensorFlow inference in the browser.

    Project mention: Run WASM, a client side Python runtime | news.ycombinator.com | 2021-09-26

    Tensorflow (and by extension Keras) offload most of the actual work to C++ or C, so having those compile to WebAssembly would (I imagine) be a herculean effort.

    Instead, The TF team maintains TFJS, which can run on WebAssembly[0].

    There are also tractjs[1], and onnyxjs[2], both of which allow you to run (most) ONNX models (which is an open standard for specifying ML models) using WebAssembly and WebGL(only onnyxjs supports WebGL). A bunch of frameworks (caffe, pytorch, TF) support exporting to/importing from ONNX.

    [0] https://blog.tensorflow.org/2020/03/introducing-webassembly-...

    [1] https://github.com/bminixhofer/tractjs

    [2] https://github.com/microsoft/onnxjs

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2022-05-19.

Rust Onnx related posts

Index

What are some of the best open-source Onnx projects in Rust? This list will help you:

Project Stars
1 tract 1,276
2 onnxruntime-rs 130
3 tractjs 66
Find remote jobs at our new job board 99remotejobs.com. There are 7 new remote jobs listed recently.
Are you hiring? Post a new remote job listing for free.
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com