Simplest way to deploy Keras NN model into C++?

• ssd_keras

  4 1,846 0.0 Python

  A Keras port of Single Shot MultiBox Detector

Don't know about simplest, but we either used caffe or tensorrt, it is maybe a bit difficult to use but I'd actually say simple fast GPU inference is what it's geared towards. There is a keras -> caffe converter https://github.com/pierluigiferrari/ssd_keras here, I think. Caffe is a c++ lib, typical, with dependencies and all. I've never heard anything of tensorflow running on c++. But with tensorrt you should get an "artifact" that you'd load, no matter where it comes from

• cppflow

  9 759 0.0 C++

  Run TensorFlow models in C++ without installation and without Bazel

If your re using keras with TensorFlow you can save it as a saved model format and then you can easily use cppflow to perform inference with it.

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project