[D] Best way to package Pytorch models as a standalone application

• Real-ESRGAN

  131 25,886 0.0 Python

  Real-ESRGAN aims at developing Practical Algorithms for General Image/Video Restoration.

I found the portable binaries of Real ESRGAN extremely easy to use (no setup involved). Just a command line tool. It does not use CUDA though. https://github.com/xinntao/Real-ESRGAN

• ncnn

  12 19,125 9.4 C++

  ncnn is a high-performance neural network inference framework optimized for the mobile platform

  

They're using NCNN to package the model. Have a look. https://github.com/Tencent/NCNN

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• DeepFaceLive

  55 13,912 8.4 Python

  Discontinued Real-time face swap for PC streaming or video calls

look at my project https://github.com/iperov/DeepFaceLive

• aitrack

  68 991 0.0 C++

  6DoF Head tracking software

This is CPU only but here is an example of a C++ windows application that uses the ONNX runtime. Packaging CUDA (TensorRT really) and getting it to work with ONNX should only be a little bit more work.

Suggest a related project