Top 23 Onnxruntime Open-Source Projects

• Deep Java Library (DJL)

  13 3,853 9.5 Java

  An Engine-Agnostic Deep Learning Framework in Java

  

• FastDeploy

  5 2,715 7.5 C++

  ⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support.

  

Project mention: Testing YOLO on Orange Pi 5 | /r/OrangePI | 2023-07-09

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• mmdeploy

  4 2,524 7.9 Python

  OpenMMLab Model Deployment Framework

  

Project mention: [D] Object detection models that can be easily converted to CoreML | /r/MachineLearning | 2023-07-25

• optimum

  8 2,157 9.5 Python

  🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools

  

Project mention: FastEmbed: Fast and Lightweight Embedding Generation for Text | dev.to | 2024-02-02

Shout out to Huggingface's Optimum – which made it easier to quantize models.

• RapidOCR

  1 1,990 8.7 Python

  Awesome OCR multiple programing languages toolkits based on ONNXRuntime, OpenVION and PaddlePaddle.

  

Project mention: FLaNK Stack 05 Feb 2024 | dev.to | 2024-02-05

• OpenSeeFace

  7 1,318 4.2 Python

  Robust realtime face and facial landmark tracking on CPU with Unity integration

• Paddle2ONNX

  1 650 8.4 Python

  ONNX Model Exporter for PaddlePaddle

  

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

• ort

  7 565 9.4 Rust

  A Rust wrapper for ONNX Runtime (by pykeio)

  

Project mention: AI Inference now available in Supabase Edge Functions | dev.to | 2024-04-16

To solve this, we built a native extension in Edge Runtime that enables using ONNX runtime via the Rust interface. This was made possible thanks to an excellent Rust wrapper called Ort:

• x-stable-diffusion

  5 546 4.5 Jupyter Notebook

  Real-time inference for Stable Diffusion - 0.88s latency. Covers AITemplate, nvFuser, TensorRT, FlashAttention. Join our Discord communty: https://discord.com/invite/TgHXuSJEk6

  

• fastT5

  5 540 0.0 Python

  ⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.

• Image-Processing-Node-Editor

  1 437 5.8 Python

  処理の検証や比較検討での用途を想定したノードエディターベースの画像処理アプリ(A node editor-based image processing application intended for use in processing verification and comparison studies)

• llama.onnx

  2 324 7.3 Python

  LLaMa/RWKV onnx models, quantization and testcase

Project mention: Qnap TS-264 | /r/LocalLLaMA | 2023-06-29

You can find LLM models in the onnx format here: https://github.com/tpoisonooo/llama.onnx

• onnxruntime-rs

  2 260 0.0 Rust

  Rust wrapper for Microsoft's ONNX Runtime (version 1.8)

• vs-mlrt

  2 232 8.6 C++

  Efficient CPU/GPU/Vulkan ML Runtimes for VapourSynth (with built-in support for waifu2x, DPIR, RealESRGANv2/v3, Real-CUGAN, RIFE, SCUNet and more!)

  

Project mention: Custom Anime4K shaders? | /r/mpv | 2023-07-05

or whatever you want, you need to write the code yourself though. https://github.com/AmusementClub/vs-mlrt

• graphsignal-python

  30 200 8.1 Python

  Graphsignal Tracer for Python

  

• OnnxStack

  3 153 9.7 C#

  C# Stable Diffusion using ONNX Runtime

Project mention: OnnxStack v0.9.0 Released - Realtime Stable Diffusion [Windows] [NoPython] | /r/StableDiffusion | 2023-11-25

• fonnx

  1 149 9.2 Dart

  ONNX runtime for Flutter.

  

Project mention: Show HN: OfflineLLM – a Vision Pro app running TinyLlama on device | news.ycombinator.com | 2024-03-01

llama.cpp at core, openai compatible API, function call support, multimodal model support, Metal support. All platforms incl. web, but WASM is slow, def. not worth it except as a proof of concept.

- FONNX: https://github.com/Telosnex/fonnx

• sd4j

  2 143 6.5 Java

  Stable diffusion pipeline in Java using ONNX Runtime

  

Project mention: FLaNK Weekly 08 Jan 2024 | dev.to | 2024-01-08

• onnxruntime_go

  1 112 6.8 Go

  A Go (golang) library wrapping microsoft/onnxruntime.

Project mention: How to create YOLOv8-based object detection web service using Python, Julia, Node.js, JavaScript, Go and Rust | dev.to | 2023-05-13

github.com/yalue/onnxruntime_go - ONNX runtime library bindings for Golang

• ortex

  2 95 6.0 Elixir

  ONNX Runtime bindings for Elixir

  

Project mention: Implementing Natural Conversational Agents with Elixir | news.ycombinator.com | 2024-04-18

• utttai

  3 49 0.0 JavaScript

  AlphaZero-like AI solution for playing Ultimate Tic-Tac-Toe in the browser

• distributed-inference

  3 46 1.0 Go

  A project to demonstrate an approach to designing cross-language and distributed pipeline in deep learning/machine learning domain, using WebRTC and Redis Streams.

• ONNXRunTime.jl

  1 41 6.1 Julia

  Julia bindings for onnxruntime

Project mention: How to create YOLOv8-based object detection web service using Python, Julia, Node.js, JavaScript, Go and Rust | dev.to | 2023-05-13

ONNXRuntime - this is the Julia bindings for ONNX runtime library.

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

Onnxruntime related posts

• Oracle-samples/sd4j: Stable Diffusion pipeline in Java using ONNX Runtime

  2 projects | news.ycombinator.com | 1 Jan 2024

• Convert Pegasus model to ONNX [Discussion]

  1 project | /r/MachineLearning | 23 Sep 2022

• Convert Pegasus model to ONNX

  1 project | /r/learnmachinelearning | 22 Sep 2022

• [P] What we learned by benchmarking TorchDynamo (PyTorch team), ONNX Runtime and TensorRT on transformers model (inference)

  1 project | /r/MachineLearning | 2 Aug 2022

• AlphaZero-Like AI for Playing Ultimate Tic-Tac-Toe in the Browser

  1 project | news.ycombinator.com | 17 Dec 2021

• [P] uttt.ai: AlphaZero-like solution for playing Ultimate Tic-Tac-Toe in the browser

  5 projects | /r/MachineLearning | 10 Dec 2021

• [P] First ever tuto to perform *GPU* quantization on 🤗 Hugging Face transformer models -> 2X faster inference

  1 project | /r/MachineLearning | 8 Dec 2021
• A note from our sponsor - SaaSHub
  www.saashub.com | 4 May 2024

  SaaSHub helps you find the best software and product alternatives Learn more →

Index

Sponsored

SaaSHub - Software Alternatives and Reviews

SaaSHub helps you find the best software and product alternatives

www.saashub.com