C++ Onnx

Open-source C++ projects categorized as Onnx
Edit details
Topics: Deep Learning Pytorch Machine Learning neural-network Android
The modern identity platform for B2B SaaS
The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
workos.com
Sponsored

Top 12 C++ Onnx Projects

  • ncnn

    ncnn is a high-performance neural network inference framework optimized for the mobile platform

    Project mention: AMD Funded a Drop-In CUDA Implementation Built on ROCm: It's Open-Source | news.ycombinator.com | 2024-02-12

    ncnn uses Vulkan for GPU acceleration, I've seen it used in a few projects to get AMD hardware support.

    https://github.com/Tencent/ncnn

  • onnxruntime

    ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

    Project mention: AI Inference now available in Supabase Edge Functions | dev.to | 2024-04-16

    Embedding generation uses the ONNX runtime under the hood. This is a cross-platform inferencing library that supports multiple execution providers from CPU to specialized GPUs.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  • onnx-simplifier

    Simplify your onnx model

  • onnx-tensorrt

    ONNX-TensorRT: TensorRT backend for ONNX

    Project mention: Introducing Cellulose - an ONNX model visualizer with hardware runtime support annotations | /r/tensorflow | 2023-05-23

    [1] - We use onnx-tensorrt for this TensorRT compatibility checks.

  • FastDeploy

    ⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support.

    Project mention: Testing YOLO on Orange Pi 5 | /r/OrangePI | 2023-07-09

  • OnnxStream

    Lightweight inference library for ONNX files, written in C++. It can run SDXL on a RPI Zero 2 but also Mistral 7B on desktops and servers.

    Project mention: Show HN: OnnxStream running TinyLlama and Mistral 7B, with CUDA support | news.ycombinator.com | 2024-01-14

  • hls4ml

    Machine learning on FPGAs using HLS

    Project mention: How to participate in open-source FPGA projects? | /r/FPGA | 2023-08-04

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  • Stable-Diffusion-NCNN

    Stable Diffusion in NCNN with c++, supported txt2img and img2img

    Project mention: Stable Diffusion implemented by ncnn framework based on C++, supported txt2img and img2img! | /r/StableDiffusion | 2023-06-08

  • optimizer

    Actively maintained ONNX Optimizer (by onnx)

    Project mention: Operationalize TensorFlow Models With ML.NET | dev.to | 2023-08-17

    If you happen to start with an ONNX model that you still want to optimize, then you can use the official ONNX optimizer tool https://github.com/onnx/optimizer.

  • deepC

    vendor independent TinyML deep learning library, compiler and inference framework microcomputers and micro-controllers

    Project mention: [D] Run Pytorch model inference on Microcontroller | /r/MachineLearning | 2023-11-14

    DeepC. Open source version of DeepSea. Very little activity, looks abandoned

  • vs-mlrt

    Efficient CPU/GPU/Vulkan ML Runtimes for VapourSynth (with built-in support for waifu2x, DPIR, RealESRGANv2/v3, Real-CUGAN, RIFE and more!)

    Project mention: Custom Anime4K shaders? | /r/mpv | 2023-07-05

    or whatever you want, you need to write the code yourself though. https://github.com/AmusementClub/vs-mlrt

  • Onnx2Text

    Converts an ONNX ML model protobuf from/to text, or tensor from/to text/CSV/raw data. (Windows command line tool)

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2024-04-16.

C++ Onnx related posts

Index

What are some of the best open-source Onnx projects in C++? This list will help you:

Project Stars
1 ncnn 19,125
2 onnxruntime 12,583
3 onnx-simplifier 3,531
4 onnx-tensorrt 2,745
5 FastDeploy 2,679
6 OnnxStream 1,718
7 hls4ml 1,089
8 Stable-Diffusion-NCNN 927
9 optimizer 587
10 deepC 505
11 vs-mlrt 229
12 Onnx2Text 15

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com