Top 10 Python Onnxruntime Projects

mmdeploy

4 2,502 8.3 Python

OpenMMLab Model Deployment Framework

Project mention: [D] Object detection models that can be easily converted to CoreML | /r/MachineLearning | 2023-07-25

optimum

8 2,141 9.5 Python

🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools

Project mention: FastEmbed: Fast and Lightweight Embedding Generation for Text | dev.to | 2024-02-02

Shout out to Huggingface's Optimum – which made it easier to quantize models.

WorkOS

workos.com sponsored

The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
RapidOCR

1 1,964 8.8 Python

Awesome OCR multiple programing languages toolkits based on ONNXRuntime, OpenVION and PaddlePaddle.

Project mention: FLaNK Stack 05 Feb 2024 | dev.to | 2024-02-05

OpenSeeFace

7 1,312 4.2 Python

Robust realtime face and facial landmark tracking on CPU with Unity integration
Paddle2ONNX

1 648 7.9 Python

ONNX Model Exporter for PaddlePaddle
fastT5

5 540 0.0 Python

⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.
Image-Processing-Node-Editor

1 432 5.8 Python

処理の検証や比較検討での用途を想定したノードエディターベースの画像処理アプリ(A node editor-based image processing application intended for use in processing verification and comparison studies)
InfluxDB

www.influxdata.com sponsored

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
llama.onnx

2 323 7.3 Python

LLaMa/RWKV onnx models, quantization and testcase

Project mention: Qnap TS-264 | /r/LocalLLaMA | 2023-06-29

You can find LLM models in the onnx format here: https://github.com/tpoisonooo/llama.onnx

graphsignal-python

30 199 7.4 Python

Graphsignal Tracer for Python
efficientnet-lite-keras

1 38 0.0 Python

Keras reimplementation of EfficientNet Lite.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python Onnxruntime related posts

Convert Pegasus model to ONNX [Discussion]
1 project | /r/MachineLearning | 23 Sep 2022
Convert Pegasus model to ONNX
1 project | /r/learnmachinelearning | 22 Sep 2022
[P] What we learned by benchmarking TorchDynamo (PyTorch team), ONNX Runtime and TensorRT on transformers model (inference)
1 project | /r/MachineLearning | 2 Aug 2022
[P] First ever tuto to perform *GPU* quantization on 🤗 Hugging Face transformer models -> 2X faster inference
1 project | /r/MachineLearning | 8 Dec 2021
[P] boost T5 models speed up to 5x & reduce the model size by 3x using fastT5.
1 project | /r/MachineLearning | 25 Mar 2021
A note from our sponsor - InfluxDB
www.influxdata.com | 25 Apr 2024

Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →

Index

What are some of the best open-source Onnxruntime projects in Python? This list will help you:

	Project	Stars
1	mmdeploy	2,502
2	optimum	2,141
3	RapidOCR	1,964
4	OpenSeeFace	1,312
5	Paddle2ONNX	648
6	fastT5	540
7	Image-Processing-Node-Editor	432
8	llama.onnx	323
9	graphsignal-python	199
10	efficientnet-lite-keras	38