C++ Onnx

Open-source C++ projects categorized as Onnx
Edit details
Topics: Deep Learning stable-diffusion Machine Learning Pytorch neural-network
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured

Top 13 C++ Onnx Projects

  • ncnn

    ncnn is a high-performance neural network inference framework optimized for the mobile platform

    • Project mention: AMD Funded a Drop-In CUDA Implementation Built on ROCm: It's Open-Source | news.ycombinator.com | 2024-02-12

    ncnn uses Vulkan for GPU acceleration, I've seen it used in a few projects to get AMD hardware support.

    https://github.com/Tencent/ncnn

  • onnxruntime

    ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

    • Project mention: SamGIS - Segment Anything applied to GIS | dev.to | 2024-05-24

    Starting from version 1.5.1 the backend integrates changes borrowed from sam_onnx_full_export, to support OnnxRuntime 1.17.x and later versions. Please note that on MacOS directly running the project from the command line suffers from memory leaks, making inference operations slower than normal. It's best therefore running the project inside a docker container, unless in case of development or debugging activities.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • onnx-simplifier

    Simplify your onnx model

  • onnx-tensorrt

    ONNX-TensorRT: TensorRT backend for ONNX

  • FastDeploy

    ⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support.

    • Project mention: Testing YOLO on Orange Pi 5 | /r/OrangePI | 2023-07-09

  • OnnxStream

    Lightweight inference library for ONNX files, written in C++. It can run SDXL on a RPI Zero 2 but also Mistral 7B on desktops and servers.

    • Project mention: Show HN: OnnxStream running TinyLlama and Mistral 7B, with CUDA support | news.ycombinator.com | 2024-01-14

  • hls4ml

    Machine learning on FPGAs using HLS

    • Project mention: How to participate in open-source FPGA projects? | /r/FPGA | 2023-08-04

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo

  • Stable-Diffusion-NCNN

    Stable Diffusion in NCNN with c++, supported txt2img and img2img

    • Project mention: Stable Diffusion implemented by ncnn framework based on C++, supported txt2img and img2img! | /r/StableDiffusion | 2023-06-08

  • optimizer

    Actively maintained ONNX Optimizer (by onnx)

    • Project mention: Operationalize TensorFlow Models With ML.NET | dev.to | 2023-08-17

    If you happen to start with an ONNX model that you still want to optimize, then you can use the official ONNX optimizer tool https://github.com/onnx/optimizer.

  • deepC

    vendor independent TinyML deep learning library, compiler and inference framework microcomputers and micro-controllers

    • Project mention: [D] Run Pytorch model inference on Microcontroller | /r/MachineLearning | 2023-11-14

    DeepC. Open source version of DeepSea. Very little activity, looks abandoned

  • unpaint

    A simple Windows / Xbox app for generating AI images with Stable Diffusion.

    • Project mention: I ported Stable Diffusion onto Xbox Series X and S. | /r/StableDiffusion | 2023-06-10

    Here are the details: Running Unpaint on the Xbox Series consoles · axodox/unpaint Wiki (github.com)

  • vs-mlrt

    Efficient CPU/GPU/Vulkan ML Runtimes for VapourSynth (with built-in support for waifu2x, DPIR, RealESRGANv2/v3, Real-CUGAN, RIFE, SCUNet and more!)

    • Project mention: Custom Anime4K shaders? | /r/mpv | 2023-07-05

    or whatever you want, you need to write the code yourself though. https://github.com/AmusementClub/vs-mlrt

  • Onnx2Text

    Converts an ONNX ML model protobuf from/to text, or tensor from/to text/CSV/raw data. (Windows command line tool)

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

C++ Onnx related posts

  • New exponent functions that make SiLU and SoftMax 2x faster, at full acc

    2 projects | news.ycombinator.com | 15 May 2024

  • Show HN: OnnxStream running TinyLlama and Mistral 7B, with CUDA support

    1 project | news.ycombinator.com | 14 Jan 2024

  • OnnxStream running TinyLlama and Mistral 7B, with CUDA support

    1 project | news.ycombinator.com | 14 Jan 2024

  • Oracle-samples/sd4j: Stable Diffusion pipeline in Java using ONNX Runtime

    2 projects | news.ycombinator.com | 1 Jan 2024

  • ONNX runtime: Cross-platform accelerated machine learning

    1 project | /r/hackernews | 27 Jul 2023

  • Onnx Runtime: “Cross-Platform Accelerated Machine Learning”

    1 project | /r/hypeurls | 27 Jul 2023

  • Running Stable Diffusion in 260MB of RAM

    1 project | /r/patient_hackernews | 22 Jul 2023
  • A note from our sponsor - InfluxDB
    www.influxdata.com | 1 Jun 2024
    Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →

Index

What are some of the best open-source Onnx projects in C++? This list will help you:

Project Stars
1 ncnn 19,460
2 onnxruntime 13,030
3 onnx-simplifier 3,605
4 onnx-tensorrt 2,785
5 FastDeploy 2,771
6 OnnxStream 1,763
7 hls4ml 1,128
8 Stable-Diffusion-NCNN 944
9 optimizer 607
10 deepC 526
11 unpaint 260
12 vs-mlrt 242
13 Onnx2Text 15

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com