Python model-inference

Open-source Python projects categorized as model-inference
Edit details
Topics: llmops lmops Kubernetes Mlops Microservices
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured

Python model-inference Projects

  • OpenLLM

    Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.

    • Project mention: First 15 Open Source Advent projects | dev.to | 2023-12-15

    13. OpenLLM by BentoML | Github | tutorial

  • BentoML

    The most flexible way to serve AI/ML models in production - Build Model Inference Service, LLM APIs, Inference Graph/Pipelines, Compound AI systems, Multi-Modal, RAG as a Service, and more!

    • Project mention: Who's hiring developer advocates? (December 2023) | dev.to | 2023-12-04

    Link to GitHub -->

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python model-inference related posts

  • The Lost Arts of CLJS Frontend

    1 project | /r/Clojure | 13 Jul 2023

  • OpenLLM: An open platform for operating large language models (LLMs) in production.

    1 project | /r/u_sasizza | 7 Jul 2023

  • OpenLLM: An open platform for operating large language models (LLMs) in production.

    1 project | /r/softwarecrafters | 30 Jun 2023

  • GPT Weekly - 26the June Edition - 🎙️ Meta's Voicebox is Paused, 🖼️SDXL 0.9, 📜AI Compliance & EU Act and more

    2 projects | /r/ChatGPT | 26 Jun 2023

  • OpenLLM: OSS to easily serve Open Source LLMs

    1 project | /r/AutoGPT | 22 Jun 2023

  • OpenLLM: OSS to easily serve Open Source LLMs

    1 project | /r/aipromptprogramming | 21 Jun 2023

  • OpenLLM: OSS to easily serve Open Source LLMs

    1 project | /r/AI_Agents | 21 Jun 2023
  • A note from our sponsor - InfluxDB
    www.influxdata.com | 2 May 2024
    Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →

Index

Project Stars
1 OpenLLM 8,813
2 BentoML 6,537

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com