The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning. Learn more →
Top 8 Python model-deployment Projects
-
BentoML
The most flexible way to serve AI/ML models in production - Build Model Inference Service, LLM APIs, Inference Graph/Pipelines, Compound AI systems, Multi-Modal, RAG as a Service, and more!
-
pinferencia
Python + Inference - Model Deployment library in Python. Simplest model inference server ever.
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
cognita
Cognita by TrueFoundry - Framework for building modular, open source RAG applications for production.
-
chitra
A multi-functional library for full-stack Deep Learning. Simplifies Model Building, API development, and Model Deployment.
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
Link to GitHub -->
Project mention: Dream – A Distributed RAG Experimentation Framework | news.ycombinator.com | 2024-04-21Hi, I've come across an open-source API-driven RAG framework launched recently. It's different from other frameworks in a lot of context. Give it a try and let me know your thoughts: https://github.com/truefoundry/cognita
Project mention: We built a website and an open-source tool for hosting and sharing ML models | /r/StableDiffusion | 2023-10-25- Cloud: https://tungsten.run (storing & running models, community) - SDK: https://github.com/tungsten-ai/tungstenkit (building/pulling/pushing models, launching web UI & API server) - Stable Diffusion template: https://github.com/tungsten-ai/tungsten-sd (building/customizing SD models easily) The website is currently in beta and I hope to hear your feedback.
Python model-deployment related posts
- MLOps level 4 tooling
- project ideas/advice for entry-level grad jobs?
- Two high schoolers trying to use Azure/GCP/AWS- need help!
- [P] Benchmarking some PyTorch Inference Servers
- PostgresML is 8-40x faster than Python HTTP microservices
- Congratulations on v1.0, BentoML 🍱 ! You are r/mlops OSS of the month!
- Show HN: Truss – serve any ML model, anywhere, without boilerplate code
-
A note from our sponsor - WorkOS
workos.com | 26 Apr 2024
Index
What are some of the best open-source model-deployment projects in Python? This list will help you:
Project | Stars | |
---|---|---|
1 | BentoML | 6,537 |
2 | pinferencia | 556 |
3 | cognita | 349 |
4 | chitra | 223 |
5 | bitbeast | 31 |
6 | tungstenkit | 24 |
7 | sdk-python | 24 |
8 | Empereur | 4 |
Sponsored