Our great sponsors
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
Looks like tfcompile still exists, but I have never used it myself. Doesn't look to be much better documented than the C++ API itself. The full C++ API of course gives you way more flexibility and doesn't involve this special process of compiling a specific model. We have been pretty happy with our additional wrapper library tensorflow_cpp, allowing us to easily load arbitrary frozen graphs and saved models for inference.
git clone https://github.com/ika-rwth-aachen/libtensorflow_cc.git && \ cd libtensorflow_cc && \ docker run --rm \ --volume $(pwd)/example:/example \ --workdir /example \ rwthika/tensorflow-cc:latest \ ./build-and-run.sh
See for example: https://github.com/tensorflow/tensorflow/issues/41904
It’s been awhile since I’ve looked at it, so not sure how hard it would be to get to work. I only commented since you mentioned that you would support other operating systems. For others interested in cross platform support there is also cppflow.