serve

Serve, optimize and scale PyTorch models in production (by pytorch)

Serve Alternatives

Similar projects and alternatives to serve

  1. Grafana

    443 serve VS Grafana

    The open and composable observability and data visualization platform. Visualize metrics, logs, and traces from multiple sources like Prometheus, Loki, Elasticsearch, InfluxDB, Postgres and many more.

  2. InfluxDB

    InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.

    InfluxDB logo
  3. transformers

    212 serve VS transformers

    🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

  4. Jenkins

    191 serve VS Jenkins

    Jenkins automation server

  5. Airflow

    187 serve VS Airflow

    Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

  6. examples

    176 serve VS examples

    TensorFlow examples (by tensorflow)

  7. ApacheKafka

    A curated re-sources list for awesome Apache Kafka

  8. MLflow

    74 serve VS MLflow

    Open source platform for the machine learning lifecycle

  9. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  10. docker

    FreeBSD port of docker, take a look at PORTING-FREEBSD.md in freebsd-compat branch (by kvasdopil)

  11. server

    28 serve VS server

    The Triton Inference Server provides an optimized cloud and edge inferencing solution. (by triton-inference-server)

  12. pinferencia

    Python + Inference - Model Deployment library in Python. Simplest model inference server ever.

  13. deepsparse

    21 serve VS deepsparse

    Sparsity-aware deep learning inference runtime for CPUs

  14. serving

    12 serve VS serving

    A flexible, high-performance serving system for machine learning models

  15. BentoML

    17 serve VS BentoML

    The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

  16. swiss_army_llama

    A FastAPI service for semantic text search using precomputed embeddings and advanced similarity measures, with built-in support for various file types through textract.

  17. kernl

    8 serve VS kernl

    Kernl lets you run PyTorch transformer models several times faster on GPU with a single line of code, and is designed to be easily hackable.

  18. kubeflow

    10 serve VS kubeflow

    Machine Learning Toolkit for Kubernetes

  19. optimum

    8 serve VS optimum

    🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools

  20. transformer-deploy

    Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer models 🚀

  21. submarine

    Discontinued Submarine is Cloud Native Machine Learning Platform. (by apache)

  22. openai-whisper-cpu

    5 serve VS openai-whisper-cpu

    Improving transcription performance of OpenAI Whisper for CPU based deployment

  23. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better serve alternative or higher similarity.

serve discussion

Log in or Post with

serve reviews and mentions

Posts with mentions or reviews of serve. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2025-01-09.

Stats

Basic serve repo stats
13
4,321
8.2
11 days ago

pytorch/serve is an open source project licensed under Apache License 2.0 which is an OSI approved license.

The primary programming language of serve is Java.


Sponsored
InfluxDB – Built for High-Performance Time Series Workloads
InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
www.influxdata.com

Did you know that Java is
the 8th most popular programming language
based on number of references?