MLServer

An inference server for your machine learning models, including support for multiple frameworks, multi-model serving and more (by SeldonIO)

MLServer Alternatives

Similar projects and alternatives to MLServer

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better MLServer alternative or higher similarity.

MLServer reviews and mentions

Posts with mentions or reviews of MLServer. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-02-12.
  • Multi-model serving options
    3 projects | /r/mlops | 12 Feb 2023
    You've already mentioned Seldon Core which is well worth looking at but if you're just after the raw multi-model serving aspect rather than a fully-fledged deployment framework you should maybe take a look at the individual inference servers: Triton Inference Server and MLServer both support multi-model serving for a wide variety of frameworks (and custom python models). MLServer might be a better option as it has an MLFlow runtime but only you will be able to decide that. There also might be other inference servers that do MMS that I'm not aware of.
  • Serving Python Machine Learning Models With Ease
    4 projects | dev.to | 12 Apr 2022
    Ever trained a new model and just wanted to use it through an API straight away? Sometimes you don't want to bother writing Flask code or containerizing your model and running it in Docker. If that sounds like you, you definitely want to check out MLServer. It's a python based inference server that recently went GA and what's really neat about it is that it's a highly-performant server designed for production environments too. That means that, by serving models locally, you are running in the exact same environment as they will be in when they get to production.
  • Ask HN: Who is hiring? (January 2022)
    28 projects | news.ycombinator.com | 3 Jan 2022
    Seldon | Multiple positions | London/Cambridge UK | Onsite/Remote | Full time | seldon.io

    At Seldon we are building industry leading solutions for deploying, monitoring, and explaining machine learning models. We are an open-core company with several successful open source projects like:

    * https://github.com/SeldonIO/seldon-core

    * https://github.com/SeldonIO/mlserver

    * https://github.com/SeldonIO/alibi

    * https://github.com/SeldonIO/alibi-detect

    * https://github.com/SeldonIO/tempo

    We are hiring for a range of positions, including software engineers(go, k8s), ml engineers (python, go), frontend engineers (js), UX designer, and product managers. All open positions can be found at https://www.seldon.io/careers/

  • Ask HN: Who is hiring? (December 2021)
    37 projects | news.ycombinator.com | 1 Dec 2021
  • A note from our sponsor - SaaSHub
    www.saashub.com | 10 May 2024
    SaaSHub helps you find the best software and product alternatives Learn more →

Stats

Basic MLServer repo stats
4
583
9.5
9 days ago

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com