Ollama Alternatives

Similar projects and alternatives to ollama

• text-generation-webui

  876 36,827 9.9 Python ollama VS text-generation-webui

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

• llama.cpp

  780 57,984 10.0 C++ ollama VS llama.cpp

  LLM inference in C/C++

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• llama

  184 53,371 8.1 Python ollama VS llama

  Inference code for Llama models

  

• whisper.cpp

  187 31,649 9.8 C ollama VS whisper.cpp

  Port of OpenAI's Whisper model in C/C++

• koboldcpp

  180 3,951 10.0 C++ ollama VS koboldcpp

  A simple one-file way to run various GGML and GGUF models with KoboldAI's UI

• gpt4all

  139 65,076 9.8 C++ ollama VS gpt4all

  gpt4all: run open-source LLMs anywhere

  

• private-gpt

  131 52,175 9.2 Python ollama VS private-gpt

  Interact with your documents using the power of GPT, 100% privately, no data leaks

  

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

• petals

  98 8,730 8.3 Python ollama VS petals

  🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

  

• llama-cpp-python

  55 6,658 9.8 Python ollama VS llama-cpp-python

  Python bindings for llama.cpp

• khoj

  50 4,885 9.9 Python ollama VS khoj

  Your AI second brain. A copilot to get answers to your questions, whether they be from your own notes or from the internet. Use powerful, online (e.g gpt4) or private, local (e.g mistral) LLMs. Self-host locally or use our web app. Access from Obsidian, Emacs, Desktop app, Web or Whatsapp.

  

• llamafile

  36 15,410 9.6 C++ ollama VS llamafile

  Distribute and run LLMs with a single file.

  

• refact

  34 1,428 9.8 JavaScript ollama VS refact

  WebUI for Fine-Tuning and Self-hosting of Open-Source Large Language Models for Coding

  

• outlines

  33 5,882 9.7 Python ollama VS outlines

  Structured Text Generation

  

• litellm

  28 8,696 10.0 Python ollama VS litellm

  Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate (100+ LLMs)

  

• llm

  24 3,047 9.4 Python ollama VS llm

  Access large language models from the command-line (by simonw)

• Cgml

  22 40 8.6 C++ ollama VS Cgml

  GPU-targeted vendor-agnostic AI library for Windows, and Mistral model implementation.

• jan

  16 18,232 10.0 TypeScript ollama VS jan

  Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)

  

• plandex

  16 9,433 9.8 Go ollama VS plandex

  An AI coding engine for building complex, real-world software with LLMs

  

• ollama-webui

  14 5,789 9.8 Svelte ollama VS ollama-webui

  Discontinued ChatGPT-Style WebUI for LLMs (Formerly Ollama WebUI) [Moved to: https://github.com/open-webui/open-webui]

  

• cortex

  8 1,635 9.8 C++ ollama VS cortex

  Drop-in, local AI alternative to the OpenAI stack. Multi-engine (llama.cpp, TensorRT-LLM). Powers 👋 Jan (by janhq)

  

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives