C++ ML

Open-source C++ projects categorized as ML
Edit details
Topics: Deep Learning Machine Learning AI neural-network Cloud
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
Sponsored

Top 15 C++ ML Projects

  • tensorflow

    An Open Source Machine Learning Framework for Everyone

    • Project mention: TensorFlow-metal on Apple Mac is junk for training | news.ycombinator.com | 2024-01-16

  • MNN

    MNN is a blazing fast, lightweight deep learning framework, battle-tested by business-critical use cases in Alibaba

    • Project mention: [D][R] Deploying deep models on memory constrained devices | /r/MachineLearning | 2023-10-03

    However, I am looking on this subject through the problem of training/finetuning deep models on the edge devices, being increasingly available thing to do. Looking at tflite, alibaba's MNN, mit-han-lab's tinyengine etc..

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • serving

    A flexible, high-performance serving system for machine learning models

    • Project mention: Llama.cpp: Full CUDA GPU Acceleration | news.ycombinator.com | 2023-06-12

    Yet another TEDIOUS BATTLE: Python vs. C++/C stack.

    This project gained popularity due to the HIGH DEMAND for running large models with 1B+ parameters, like `llama`. Python dominates the interface and training ecosystem, but prior to llama.cpp, non-ML professionals showed little interest in a fast C++ interface library. While existing solutions like tensorflow-serving [1] in C++ were sufficiently fast with GPU support, llama.cpp took the initiative to optimize for CPU and trim unnecessary code, essentially code-golfing and sacrificing some algorithm correctness for improved performance, which isn't favored by "ML research".

    NOTE: In my opinion, a true pioneer was DarkNet, which implemented the YOLO model series and significantly outperformed others [2]. Same trick basically like llama.cpp

    [1] https://github.com/tensorflow/serving

  • oneflow

    OneFlow is a deep learning framework designed to be user-friendly, scalable and efficient.

  • flashlight

    A C++ standalone library for machine learning (by flashlight)

    • Project mention: MatX: Efficient C++17 GPU numerical computing library with Python-like syntax | news.ycombinator.com | 2023-10-03

    I think a comparison to PyTorch, TensorFlow and/or JAX is more relevant than a comparison to CuPy/NumPy.

    And then maybe also a comparison to Flashlight (https://github.com/flashlight/flashlight) or other C/C++ based ML/computing libraries?

    Also, there is no mention of it, so I suppose this does not support automatic differentiation?

  • yggdrasil-decision-forests

    A library to train, evaluate, interpret, and productionize decision forest models such as Random Forest and Gradient Boosted Decision Trees.

    • Project mention: Why do tree-based models still outperform deep learning on tabular data? (2022) | news.ycombinator.com | 2024-03-05

    Is it this library https://github.com/google/yggdrasil-decision-forests ?

  • ML-examples

    Arm Machine Learning tutorials and examples

    • Project mention: [D] Run Pytorch model inference on Microcontroller | /r/MachineLearning | 2023-11-14

    CMSIS-NN. ARM centric. Examples. They also have an example for a pytorch to tflite converter via onnx

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo

  • ecole

    Extensible Combinatorial Optimization Learning Environments

  • liboai

    A C++17 library to access the entire OpenAI API.

    • Project mention: Revolutionizing Real-Time Alerts with AI, NATs and Streamlit | dev.to | 2024-02-18

    Imagine you have an AI-powered personal alerting chat assistant that interacts using up-to-date data. Whether it's a big move in the stock market that affects your investments, any significant change on your shared SharePoint documents, or discounts on Amazon you were waiting for, the application is designed to keep you informed and alert you about any significant changes based on the criteria you set in advance using your natural language. In this post, we will learn how to build a full-stack event-driven weather alert chat application in Python using pretty cool tools: Streamlit, NATS, and OpenAI. The app can collect real-time weather information, understand your criteria for alerts using AI, and deliver these alerts to the user interface.

  • rb-libsvm

    Ruby language bindings for LIBSVM

  • vs-mlrt

    Efficient CPU/GPU/Vulkan ML Runtimes for VapourSynth (with built-in support for waifu2x, DPIR, RealESRGANv2/v3, Real-CUGAN, RIFE, SCUNet, SwinIR and more!)

    • Project mention: Custom Anime4K shaders? | /r/mpv | 2023-07-05

    or whatever you want, you need to write the code yourself though. https://github.com/AmusementClub/vs-mlrt

  • arduino-library

    This repository holds the Arduino Library for the EdX TinyML Specialization

    • Project mention: MIT 6.5940: TinyML and Efficient Deep Learning Computing | news.ycombinator.com | 2023-09-28

    These TinyML courses on edx look good https://www.edx.org/professional-certificate/harvardx-tiny-m...

  • PyHook

    Python hook for ReShade processing (by dwojtasik)

  • CuProphet

    Prophet built for CUDA and Speed

    • Project mention: [P] CuProphet (Stan model with CUDA) | /r/MachineLearning | 2023-07-08

  • tinymind

    Tinymind is a Neural Network and Machine Learning project intended to provide a C++ template library for neural nets and machine learning algorithms within embedded systems.

    • Project mention: Is there anything like Embedded Artificial Intelligence & Machine Learning? Can anyone tell me more about it? | /r/embedded | 2023-12-07

    Take a look at TinyMind: https://github.com/danmcleran/tinymind

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

C++ ML related posts

Index

What are some of the best open-source ML projects in C++? This list will help you:

Project Stars
1 tensorflow 182,456
2 MNN 8,293
3 serving 6,071
4 oneflow 5,721
5 flashlight 5,145
6 yggdrasil-decision-forests 423
7 ML-examples 404
8 ecole 296
9 liboai 291
10 rb-libsvm 278
11 vs-mlrt 230
12 arduino-library 38
13 PyHook 23
14 CuProphet 8
15 tinymind 7

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com