Top 3 Python triton-inference-server Projects
-
GenerativeAIExamples
Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
Python triton-inference-server related posts
- Convert Pegasus model to ONNX [Discussion]
- [P] What we learned by benchmarking TorchDynamo (PyTorch team), ONNX Runtime and TensorRT on transformers model (inference)
- [P] First ever tuto to perform *GPU* quantization on 🤗 Hugging Face transformer models -> 2X faster inference
- A Quantitative Comparison of Serving Platforms for Neural Networks
Index
What are some of the best open-source triton-inference-server projects in Python? This list will help you:
Project | Stars | |
---|---|---|
1 | GenerativeAIExamples | 1,535 |
2 | tritony | 37 |
3 | serving-compare-middleware | 14 |
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com