Export and run models with ONNX

• hummingbird

  9 3,302 7.1 Python

  Hummingbird compiles trained ML models into tensor computation for faster inference.

  

ONNX opens an avenue for direct inference using a number of languages and platforms. For example, a model could be run directly on Android to limit data sent to a third party service. ONNX is an exciting development with a lot of promise. Microsoft has also released Hummingbird which enables exporting traditional models (sklearn, decision trees, logistical regression..) to ONNX.

• sentence-transformers

  45 13,793 9.2 Python

  Multilingual Sentence & Image Embeddings with BERT

  

The ONNX pipeline also supports exporting sentence embeddings models trained with the sentence-transformers package.

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• onnx

  38 16,858 9.5 Python

  Open standard for machine learning interoperability

  

The ONNX runtime provides a common serialization format for machine learning models. ONNX supports a number of different platforms/languages and has features built in to help reduce inference time.

Suggest a related project