SaaSHub helps you find the best software and product alternatives Learn more →
Onnxruntime Alternatives
Similar projects and alternatives to onnxruntime
-
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
-
-
transformers
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
-
-
-
MLflow
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.
-
-
-
transformers.js
State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!
-
-
DirectXShaderCompiler
This repo hosts the source for the DirectX Shader Compiler which is based on LLVM/Clang.
-
-
-
TensorRT
NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.
-
wonnx
Discontinued A WebGPU-accelerated ONNX inference run-time written 100% in Rust, ready for native and the web
-
-
-
-
vectordb
A minimal Python package for storing and retrieving text using chunking, embeddings, and vector search. (by kagisearch)
NOTE:
The number of mentions on this list indicates mentions on common posts plus user suggested alternatives.
Hence, a higher number means a better onnxruntime alternative or higher similarity.
onnxruntime discussion
onnxruntime reviews and mentions
Posts with mentions or reviews of onnxruntime.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2026-05-23.
-
I Built a Neural Network Engine in C# That Runs in Your Browser - No ONNX Runtime, No JavaScript Bridge, No Native Binaries
Half of the answer is technical curiosity. The other half is that the current ML-in-the-browser landscape is dominated by ONNX Runtime Web, which has a fundamental WebGPU device-sharing bug that's been ignored for six months (microsoft/onnxruntime#26107). That bug is a wall for anyone trying to ship more than one model in a single browser session. It pushed me from "I wonder if I could do this" to "I'm doing this."
-
They Don't Have the Money (And Neither Do You): The Coming Era of Small Models
The techniques are well-understood. Google's Vertex AI, Amazon SageMaker, Microsoft's ONNX Runtime, and OpenAI's fine-tuning API all support distillation workflows now. It's become fundamental technique, not experimental.
-
I Stopped Paying for Subtitle Services After Running Whisper in a Browser Tab
Then I thought: OpenAI released Whisper as open source in 2022. It's been ported to ONNX, to Core ML, to WebAssembly. If someone can run Stable Diffusion in a browser tab, running a speech-to-text model shouldn't be harder.
-
I Ran a Neural Network in a Browser Tab to Split a Song into Stems
The Audio Stem Splitter on Kitmul loads an ONNX-exported version of the Demucs model and runs inference entirely via ONNX Runtime Web backed by WebAssembly. No server. No upload. The audio bytes never leave your machine.
-
How I started Inference4j - an open source ML project in java with the help of Claude
I stumbled upon ONNX runtime and was immediately hooked. A portable binary execution of a self-contained Neural Network Model.
-
Show HN: TTSLab – A voice AI agent and TTS lab running in the browser via WebGPU
3. Did the Voice Agent work for you? That's the most experimental part.
Built on top of ONNX Runtime Web (https://onnxruntime.ai) and Transformers.js — huge thanks to those communities for making in-browser ML inference possible.
-
15 years later, Microsoft morged my diagram
Seems like this is going to be the year of AI slop being released everywhere by Microsoft. Just wish they'd put as much effort into a post morten for this one as they're doing for a diagram on a blog post https://github.com/microsoft/onnxruntime/issues/27263#issuec...
-
GSoC 2026 Predictions: 30 NEW AI/ML/Security Organizations You Should Start Contributing to NOW!
Main: https://github.com/microsoft/onnxruntime ⭐ 15k+
-
ONNX Runtime and CoreML May Silently Convert Your Model to FP16
Thank you for reading.
Also generally I think CoreML isn't the best. The best solution for ORT would probably be to introduce a pure MPS provider (https://github.com/microsoft/onnxruntime/issues/21271), but given they've already bought into CoreML the effort may not be worth the reward for the core team. Which fair enough as it's a pretty mammoth task
-
Accelerating LLM Inference: How C++, ONNX, and llama.cpp Power Efficient AI
ONNX Runtime GitHub
-
A note from our sponsor - SaaSHub
www.saashub.com | 6 Jun 2026
Stats
Basic onnxruntime repo stats
78
20,726
10.0
2 days ago
microsoft/onnxruntime is an open source project licensed under MIT License which is an OSI approved license.
The primary programming language of onnxruntime is C++.
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com