tritony
Tiny configuration for Triton Inference Server (by rtzr)
quick-deploy
Optimize, convert and deploy machine learning models as fast inference API using Triton and ORT. Currently support Hugging Face transformers, PyToch, Tensorflow, SKLearn and XGBoost models. (by rodrigobaron)
| tritony | quick-deploy | |
|---|---|---|
| 1 | 1 | |
| 38 | 6 | |
| - | - | |
| 6.4 | 0.0 | |
| 5 months ago | about 2 years ago | |
| Python | Python | |
| BSD 3-clause "New" or "Revised" License | Apache License 2.0 |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
tritony
Posts with mentions or reviews of tritony.
We have used some of these posts to build our list of alternatives
and similar projects.
-
Are you using `Triton Inference Server`?
Check it https://github.com/rtzr/tritony !
quick-deploy
Posts with mentions or reviews of quick-deploy.
We have used some of these posts to build our list of alternatives
and similar projects.
-
[P] Quick-Deploy - Optimize, convert and deploy machine learning models
github: https://github.com/rodrigobaron/quick-deploy
What are some alternatives?
When comparing tritony and quick-deploy you can also consider the following projects:
vllm - A high-throughput and memory-efficient inference and serving engine for LLMs
examples - 📝 Examples of how to use Neptune for different use cases and with various MLOps tools
budgetml - Deploy a ML inference service on a budget in less than 10 lines of code.
amazon-sagemaker-local-mode - Amazon SageMaker Local Mode Examples
DeepSpeed - DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
kserve - Standardized Serverless ML Inference Platform on Kubernetes
serving-compare-middleware - FastAPI middleware for comparing different ML model serving approaches
ColossalAI - Making large AI models cheaper, faster and more accessible