[D] ONNX ecosystem

• onnxruntime

  53 12,583 10.0 C++

  ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

  

The ONNX runtime provides a common serialization format for machine learning models. ONNX supports a number of different platforms/languages and has features built in to help reduce inference time.

• onnxmltools

  3 936 6.2 Python

  ONNXMLTools enables conversion of models to ONNX

  

PyTorch has robust support for exporting Torch models to ONNX. This enables exporting Hugging Face Transformers and/or other downstream models directly to ONNX. With the onnxmltools library, traditional models from scikit-learn, XGBoost and others can be exported to ONNX.

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• txtai

  354 6,910 9.3 Python

  💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows

  

Interested in hearing if anyone is using ONNX in their work. I've extensively started to use ONNX with txtai (example, example).

Suggest a related project