Train Your AI Model Once and Deploy on Any Cloud

• FasterTransformer

  7 5,456 4.3 C++

  Transformer related optimization, including BERT, GPT

  

https://docs.nvidia.com/ai-enterprise/overview/0.1.0/platfor...

RIVA: NVIDIA® Riva, a premium edition of NVIDIA AI Enterprise software, is a GPU-accelerated speech and translation AI SDK

FasterTransformer: https://github.com/NVIDIA/FasterTransformer an

• TensorRT

  22 9,065 5.0 C++

  NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

  

highly optimized transformer-based encoder and decoder component, supported on pytorch, tensorflow and triton

TensorRT, custom ml framework/ inference runtime from nvidia, https://developer.nvidia.com/tensorrt, but you have to port your models

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• SCNN

  18 794 0.0 Lua

  Spatial CNN for traffic lane detection (AAAI2018)

Suggest a related project