[D] Deep Learning Framework for C++.

This page summarizes the projects mentioned and recommended in the original post on /r/MachineLearning

Our great sponsors
  • InfluxDB - Collect and Analyze Billions of Data Points in Real Time
  • Revelo Payroll - Free Global Payroll designed for tech teams
  • SonarCloud - Analyze your C and C++ projects with just one click.
  • Onboard AI - Learn any GitHub repo in 59 seconds
  • mmaction2

    OpenMMLab's Next Generation Video Understanding Toolbox and Benchmark

    I agree with you for most of the time this can work but there are some models that have certain layers that are not supported by ONNX. An example would be Spatiotemporal models in mmaction2 from open-mmlab.

  • deepdetect

    Deep Learning API and Server in C++14 support for Caffe, PyTorch,TensorRT, Dlib, NCNN, Tensorflow, XGBoost and TSNE

    But you need to have good reasons to do it. Ours is that we have a multi-backend framework, and that we don't want any step in between dev & run. C++ allows for this since the same code can run on training server and edge device as needed. It also allows for building full AI applicatioms with great performances (e g. real time) We dev & use https://github.com/jolibrain/deepdetect for these purposes and it serves us very well, but it's not the faint of heart !

  • InfluxDB

    Collect and Analyze Billions of Data Points in Real Time. Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.

  • marian

    Fast Neural Machine Translation in C++

  • Pytorch

    Tensors and Dynamic neural networks in Python with strong GPU acceleration

  • flashlight

    A C++ standalone library for machine learning (by flashlight)

    I built and maintain Flashlight, a C++-first library for ML/DL. We built Flashlight to be:

  • ArrayFire

    ArrayFire: a general purpose GPU library.

    Low-overhead — not our goal, but Flashlight is on par with or outperforming most other ML/DL frameworks with its ArrayFire reference tensor implementation, especially on nonstandard setups where framework overhead matters

  • mdspan

    Reference implementation of mdspan targeting C++23

    I'm aware of only two relevant projects myself, I don't know much, came to reddit kind of by chance. One of the multi-dimensional array libraries proposed for potential standardisation, and a gnu machine learning library that was discontinued which could be worked off of. There's probably a lot more out there, but don't get distracted from making something awesome :)

  • Revelo Payroll

    Free Global Payroll designed for tech teams. Building a great tech team takes more than a paycheck. Zero payroll costs, get AI-driven insights to retain best talent, and delight them with amazing local benefits. 100% free and compliant.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts