LocalAI Alternatives

Similar projects and alternatives to LocalAI

• text-generation-webui

  876 35,862 9.9 Python LocalAI VS text-generation-webui

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

• llama.cpp

  769 55,846 10.0 C++ LocalAI VS llama.cpp

  LLM inference in C/C++

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• ollama

  191 58,943 9.9 Go LocalAI VS ollama

  Get up and running with Llama 3, Mistral, Gemma, and other large language models.

  

• AutoGPT

  180 161,096 10.0 JavaScript LocalAI VS AutoGPT

  AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

  

• koboldcpp

  179 3,749 10.0 C++ LocalAI VS koboldcpp

  A simple one-file way to run various GGML and GGUF models with KoboldAI's UI

• gpt4all

  139 63,641 9.8 C++ LocalAI VS gpt4all

  gpt4all: run open-source LLMs anywhere

  

• private-gpt

  131 51,534 9.2 Python LocalAI VS private-gpt

  Interact with your documents using the power of GPT, 100% privately, no data leaks

  

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• AgentGPT

  97 29,684 9.7 TypeScript LocalAI VS AgentGPT

  🤖 Assemble, configure, and deploy autonomous AI Agents in your browser.

  

• guidance

  89 12,248 9.5 Jupyter Notebook LocalAI VS guidance

  Discontinued A guidance language for controlling large language models. [Moved to: https://github.com/guidance-ai/guidance] (by microsoft)

  

• FastChat

  82 33,668 9.7 Python LocalAI VS FastChat

  An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

  

• qlora

  80 9,344 7.4 Jupyter Notebook LocalAI VS qlora

  QLoRA: Efficient Finetuning of Quantized LLMs

• tree-of-thought-llm

  41 4,138 7.2 Python LocalAI VS tree-of-thought-llm

  [NeurIPS 2023] Tree of Thoughts: Deliberate Problem Solving with Large Language Models

  

• serge

  40 5,535 9.8 Svelte LocalAI VS serge

  A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.

  

• litellm

  28 7,982 10.0 Python LocalAI VS litellm

  Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate (100+ LLMs)

  

• basaran

  22 1,281 10.0 Python LocalAI VS basaran

  Discontinued Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models.

  

• marvin

  16 4,695 9.9 Python LocalAI VS marvin

  ✨ Build AI interfaces that spark joy

  

• mods

  11 2,357 9.1 Go LocalAI VS mods

  AI on the command line

  

• magentic

  10 1,575 9.2 Python LocalAI VS magentic

  Seamlessly integrate LLMs as Python functions

• llama-cpp-python

  54 6,378 9.9 Python LocalAI VS llama-cpp-python

  Python bindings for llama.cpp

• go-llama.cpp

  4 554 8.4 C++ LocalAI VS go-llama.cpp

  LLama.cpp golang bindings

  

• SaaSHub

  www.saashub.com sponsored

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives