[D] Deep Learning Framework for C++.

• mmaction2

  5 3,884 7.8 Python

  OpenMMLab's Next Generation Video Understanding Toolbox and Benchmark

  

I agree with you for most of the time this can work but there are some models that have certain layers that are not supported by ONNX. An example would be Spatiotemporal models in mmaction2 from open-mmlab.

• deepdetect

  4 2,493 7.0 C++

  Deep Learning API and Server in C++14 support for Caffe, PyTorch,TensorRT, Dlib, NCNN, Tensorflow, XGBoost and TSNE

  

But you need to have good reasons to do it. Ours is that we have a multi-backend framework, and that we don't want any step in between dev & run. C++ allows for this since the same code can run on training server and edge device as needed. It also allows for building full AI applicatioms with great performances (e g. real time) We dev & use https://github.com/jolibrain/deepdetect for these purposes and it serves us very well, but it's not the faint of heart !

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• marian

  3 1,167 0.0 C++

  Fast Neural Machine Translation in C++

  

• Pytorch

  336 77,783 10.0 Python

  Tensors and Dynamic neural networks in Python with strong GPU acceleration

  

• flashlight

  16 5,145 7.7 C++

  A C++ standalone library for machine learning (by flashlight)

  

I built and maintain Flashlight, a C++-first library for ML/DL. We built Flashlight to be:

• ArrayFire

  6 4,395 7.8 C++

  ArrayFire: a general purpose GPU library.

  

Low-overhead — not our goal, but Flashlight is on par with or outperforming most other ML/DL frameworks with its ArrayFire reference tensor implementation, especially on nonstandard setups where framework overhead matters

• mdspan

  6 372 8.7 C++

  Reference implementation of mdspan targeting C++23

  

I'm aware of only two relevant projects myself, I don't know much, came to reddit kind of by chance. One of the multi-dimensional array libraries proposed for potential standardisation, and a gnu machine learning library that was discontinued which could be worked off of. There's probably a lot more out there, but don't get distracted from making something awesome :)

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

Suggest a related project