[P] [D]How to get TensorFlow model to run on Jetson Nano?

• keras-onnx

  2 329 4.4 Python

  Discontinued Convert tf.keras/Keras models to ONNX

  

Conversion was done from Keras Tensorflow using to ONNX https://github.com/onnx/keras-onnx followed by ONNX to TensorRT using https://github.com/onnx/onnx-tensorrt The Python code used for inference using TensorRT can be found at https://github.com/jonnor/modeld/blob/tensorrt/tensorrtutils.py

• onnx-tensorrt

  4 2,749 4.1 C++

  ONNX-TensorRT: TensorRT backend for ONNX

  

Conversion was done from Keras Tensorflow using to ONNX https://github.com/onnx/keras-onnx followed by ONNX to TensorRT using https://github.com/onnx/onnx-tensorrt The Python code used for inference using TensorRT can be found at https://github.com/jonnor/modeld/blob/tensorrt/tensorrtutils.py

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• modeld

  1 0 0.0

  Self driving car lane and path detection

Conversion was done from Keras Tensorflow using to ONNX https://github.com/onnx/keras-onnx followed by ONNX to TensorRT using https://github.com/onnx/onnx-tensorrt The Python code used for inference using TensorRT can be found at https://github.com/jonnor/modeld/blob/tensorrt/tensorrtutils.py

• server

  24 7,314 9.5 Python

  The Triton Inference Server provides an optimized cloud and edge inferencing solution. (by triton-inference-server)

  

There is a stand-alone triton server that will take tensorflow models (and others) and run them directly: https://github.com/triton-inference-server/server/releases/tag/v2.10.0

Suggest a related project