LocalAI

:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference (by mudler)

LocalAI Alternatives

Similar projects and alternatives to LocalAI

  1. llama.cpp

    LLM inference in C/C++

  2. InfluxDB

    InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.

    InfluxDB logo
  3. text-generation-webui

    A Gradio web UI for Large Language Models with support for multiple inference backends.

  4. ollama

    492 LocalAI VS ollama

    Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, Mistral Small 3.1 and other large language models.

  5. AutoGPT

    188 LocalAI VS AutoGPT

    AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

  6. koboldcpp

    Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

  7. gpt4all

    GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

  8. private-gpt

    Interact with your documents using the power of GPT, 100% privately, no data leaks

  9. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  10. AgentGPT

    99 LocalAI VS AgentGPT

    🤖 Assemble, configure, and deploy autonomous AI Agents in your browser.

  11. FastChat

    86 LocalAI VS FastChat

    An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

  12. guidance

    90 LocalAI VS guidance

    Discontinued A guidance language for controlling large language models. [Moved to: https://github.com/guidance-ai/guidance] (by microsoft)

  13. llama-cpp-python

    Python bindings for llama.cpp

  14. litellm

    47 LocalAI VS litellm

    Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

  15. serge

    40 LocalAI VS serge

    A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.

  16. text-generation-inference

    Large Language Model Text Generation Inference

  17. k8sgpt

    Giving Kubernetes Superpowers to everyone

  18. magentic

    15 LocalAI VS magentic

    Seamlessly integrate LLMs as Python functions

  19. jupyter-ai

    13 LocalAI VS jupyter-ai

    A generative AI extension for JupyterLab

  20. pretzelai

    9 LocalAI VS pretzelai

    The modern replacement for Jupyter Notebooks

  21. localGPT

    29 LocalAI VS localGPT

    Chat with your documents on your local device using GPT models. No data leaves your device and 100% private.

  22. go-llama.cpp

    LLama.cpp golang bindings

  23. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better LocalAI alternative or higher similarity.

LocalAI discussion

Log in or Post with

LocalAI reviews and mentions

Posts with mentions or reviews of LocalAI. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2024-12-28.

Stats

Basic LocalAI repo stats
90
32,587
9.9
4 days ago

Sponsored
InfluxDB – Built for High-Performance Time Series Workloads
InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
www.influxdata.com

Did you know that Go is
the 4th most popular programming language
based on number of references?