[D] Deep Learning Framework for C++.

This page summarizes the projects mentioned and recommended in the original post on /r/MachineLearning

SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured
  • mmaction2

    OpenMMLab's Next Generation Video Understanding Toolbox and Benchmark

    I agree with you for most of the time this can work but there are some models that have certain layers that are not supported by ONNX. An example would be Spatiotemporal models in mmaction2 from open-mmlab.

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  • deepdetect

    Deep Learning API and Server in C++14 support for Caffe, PyTorch,TensorRT, Dlib, NCNN, Tensorflow, XGBoost and TSNE

    But you need to have good reasons to do it. Ours is that we have a multi-backend framework, and that we don't want any step in between dev & run. C++ allows for this since the same code can run on training server and edge device as needed. It also allows for building full AI applicatioms with great performances (e g. real time) We dev & use https://github.com/jolibrain/deepdetect for these purposes and it serves us very well, but it's not the faint of heart !

  • marian

    Fast Neural Machine Translation in C++

  • Pytorch

    Tensors and Dynamic neural networks in Python with strong GPU acceleration

  • flashlight

    A C++ standalone library for machine learning (by flashlight)

    I built and maintain Flashlight, a C++-first library for ML/DL. We built Flashlight to be:

  • ArrayFire

    ArrayFire: a general purpose GPU library.

    Low-overhead — not our goal, but Flashlight is on par with or outperforming most other ML/DL frameworks with its ArrayFire reference tensor implementation, especially on nonstandard setups where framework overhead matters

  • mdspan

    Reference implementation of mdspan targeting C++23

    I'm aware of only two relevant projects myself, I don't know much, came to reddit kind of by chance. One of the multi-dimensional array libraries proposed for potential standardisation, and a gnu machine learning library that was discontinued which could be worked off of. There's probably a lot more out there, but don't get distracted from making something awesome :)

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • TransformerEngine: A library for accelerating Transformer models on Nvidia GPUs

    1 project | news.ycombinator.com | 25 Sep 2024
  • Ivy: All in one machine learning framework

    1 project | news.ycombinator.com | 1 Aug 2023
  • Ivy ML Transpiler and Framework

    1 project | news.ycombinator.com | 1 Aug 2023
  • Benchmarking Large Language Models on NVIDIA H100 GPUs with CoreWeave (Part 1)

    1 project | /r/nvidia | 30 Apr 2023
  • Ask for help: what is the best way to have code both support torch and numpy?

    1 project | /r/pytorch | 22 Feb 2023

Did you konow that C++ is
the 6th most popular programming language
based on number of metions?