LocalAI

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required. (by mudler)

LocalAI Alternatives

Similar projects and alternatives to LocalAI

  1. llama.cpp

    LLM inference in C/C++

  2. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  3. textgen

    887 LocalAI VS textgen

    Open-source desktop app for local LLMs. Text, vision, tool-calling, OpenAI/Anthropic-compatible API. 100% private.

  4. ollama

    750 LocalAI VS ollama

    Get up and running with Kimi-K2.6, GLM-5.1, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

  5. AutoGPT

    194 LocalAI VS AutoGPT

    AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

  6. koboldcpp

    Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

  7. gpt4all

    GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

  8. private-gpt

    Interact with your documents using the power of GPT, 100% privately, no data leaks

  9. litellm

    102 LocalAI VS litellm

    Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

  10. AgentGPT

    99 LocalAI VS AgentGPT

    Discontinued 🤖 Assemble, configure, and deploy autonomous AI Agents in your browser.

  11. vllm

    91 LocalAI VS vllm

    A high-throughput and memory-efficient inference and serving engine for LLMs

  12. guidance

    91 LocalAI VS guidance

    Discontinued A guidance language for controlling large language models. [Moved to: https://github.com/guidance-ai/guidance] (by microsoft)

  13. FastChat

    86 LocalAI VS FastChat

    An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

  14. llama-cpp-python

    Python bindings for llama.cpp

  15. serge

    40 LocalAI VS serge

    A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.

  16. k8sgpt

    Giving Kubernetes Superpowers to everyone

  17. magentic

    16 LocalAI VS magentic

    Seamlessly integrate LLMs as Python functions

  18. jupyter-ai

    13 LocalAI VS jupyter-ai

    An open source extension that connects AI agents to computational notebooks in JupyterLab.

  19. pretzelai

    9 LocalAI VS pretzelai

    The modern replacement for Jupyter Notebooks

  20. wiggle

    Discontinued Multi-Node LLM Processing Framework (by dshills)

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better LocalAI alternative or higher similarity.

LocalAI discussion

Log in or Post with

LocalAI reviews and mentions

Posts with mentions or reviews of LocalAI. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2026-06-02.

Stats

Basic LocalAI repo stats
96
46,816
9.9
1 day ago

mudler/LocalAI is an open source project licensed under MIT License which is an OSI approved license.

The primary programming language of LocalAI is Go.


Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com