C++ deep-neural-networks

Open-source C++ projects categorized as deep-neural-networks
Edit details
Topics: Deep Learning Machine Learning neural-network ML Python
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
Sponsored

Top 14 C++ deep-neural-network Projects

  • tensorflow

    An Open Source Machine Learning Framework for Everyone

    • Project mention: TensorFlow-metal on Apple Mac is junk for training | news.ycombinator.com | 2024-01-16

  • CNTK

    Microsoft Cognitive Toolkit (CNTK), an open source deep-learning toolkit

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo

  • MNN

    MNN is a blazing fast, lightweight deep learning framework, battle-tested by business-critical use cases in Alibaba

    • Project mention: [D][R] Deploying deep models on memory constrained devices | /r/MachineLearning | 2023-10-03

    However, I am looking on this subject through the problem of training/finetuning deep models on the edge devices, being increasingly available thing to do. Looking at tflite, alibaba's MNN, mit-han-lab's tinyengine etc..

  • serving

    A flexible, high-performance serving system for machine learning models

    • Project mention: Llama.cpp: Full CUDA GPU Acceleration | news.ycombinator.com | 2023-06-12

    Yet another TEDIOUS BATTLE: Python vs. C++/C stack.

    This project gained popularity due to the HIGH DEMAND for running large models with 1B+ parameters, like `llama`. Python dominates the interface and training ecosystem, but prior to llama.cpp, non-ML professionals showed little interest in a fast C++ interface library. While existing solutions like tensorflow-serving [1] in C++ were sufficiently fast with GPU support, llama.cpp took the initiative to optimize for CPU and trim unnecessary code, essentially code-golfing and sacrificing some algorithm correctness for improved performance, which isn't favored by "ML research".

    NOTE: In my opinion, a true pioneer was DarkNet, which implemented the YOLO model series and significantly outperformed others [2]. Same trick basically like llama.cpp

    [1] https://github.com/tensorflow/serving

  • oneflow

    OneFlow is a deep learning framework designed to be user-friendly, scalable and efficient.

  • oneDNN

    oneAPI Deep Neural Network Library (oneDNN)

    • Project mention: Blaze: A High Performance C++ Math library | news.ycombinator.com | 2024-04-17

    If you are talking about non-small matrix multiplication in MKL, is now in opensource as a part of oneDNN. It literally has exactly the same code, as in MKL (you can see this by inspecting constants or doing high-precision benchmarks).

    For small matmul there is libxsmm. It may take tremendous efforts make something faster than oneDNN and libxsmm, as jit-based approach of https://github.com/oneapi-src/oneDNN/blob/main/src/gpu/jit/g... is too flexible: if someone finds a better sequence, oneDNN can reuse it without major change of design.

    But MKL is not limited to matmul, I understand it...

  • CTranslate2

    Fast inference engine for Transformer models

    • Project mention: Distil-Whisper: distilled version of Whisper that is 6 times faster, 49% smaller | news.ycombinator.com | 2023-10-31

    Just a point of clarification - faster-whisper references it but ctranslate2[0] is what's really doing the magic here.

    Ctranslate2 is a sleeper powerhouse project that enables a lot. They should be up front and center and get the credit they deserve.

    [0] - https://github.com/OpenNMT/CTranslate2

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • self-driving-car

    Udacity Self-Driving Car Engineer Nanodegree projects. (by ndrplz)

  • PoseEstimationForMobile

    :dancer: Real-time single person pose estimation for Android and iOS.

  • ML-examples

    Arm Machine Learning tutorials and examples

    • Project mention: [D] Run Pytorch model inference on Microcontroller | /r/MachineLearning | 2023-11-14

    CMSIS-NN. ARM centric. Examples. They also have an example for a pytorch to tflite converter via onnx

  • signatory

    Differentiable computations of the signature and logsignature transforms, on both CPU and GPU. (ICLR 2021)

  • dlprimitives

    Deep Learning Primitives and Mini-Framework for OpenCL

    • Project mention: Dlprimitives: Deep Learning Primitives and Mini-Framework for OpenCL | news.ycombinator.com | 2023-06-17

  • deep_grasp_demo

    Deep learning for grasp detection within MoveIt.

  • FLARE

    C++ Neural Network Library (by rkuang9)

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

C++ deep-neural-networks related posts

Index

What are some of the best open-source deep-neural-network projects in C++? This list will help you:

Project Stars
1 tensorflow 182,456
2 CNTK 17,435
3 MNN 8,293
4 serving 6,071
5 oneflow 5,721
6 oneDNN 3,456
7 CTranslate2 2,776
8 self-driving-car 2,690
9 PoseEstimationForMobile 991
10 ML-examples 404
11 signatory 249
12 dlprimitives 156
13 deep_grasp_demo 96
14 FLARE 10

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com