Llama.cpp Alternatives

Similar projects and alternatives to llama.cpp

• text-generation-webui

  876 35,583 9.9 Python llama.cpp VS text-generation-webui

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

• ollama

  187 55,134 9.9 Go llama.cpp VS ollama

  Get up and running with Llama 2, Mistral, Gemma, and other large language models.

  

• WorkOS

  workos.com

  sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• whisper.cpp

  187 29,540 9.8 C llama.cpp VS whisper.cpp

  Port of OpenAI's Whisper model in C/C++

• llama

  183 52,244 8.2 Python llama.cpp VS llama

  Inference code for Llama models

  

• koboldcpp

  179 3,683 10.0 C++ llama.cpp VS koboldcpp

  A simple one-file way to run various GGML and GGUF models with KoboldAI's UI

• gpt4all

  139 63,641 9.8 C++ llama.cpp VS gpt4all

  gpt4all: run open-source LLMs anywhere

  

• stanford_alpaca

  108 28,723 2.0 Python llama.cpp VS stanford_alpaca

  Code and documentation to train Stanford's Alpaca models, and generate the data.

  

• InfluxDB

  www.influxdata.com

  sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• alpaca-lora

  107 18,137 3.6 Jupyter Notebook llama.cpp VS alpaca-lora

  Instruct-tune LLaMA on consumer hardware

• alpaca.cpp

  94 9,878 9.4 C llama.cpp VS alpaca.cpp

  Discontinued Locally run an Instruction-Tuned Chat-Style LLM

• mlc-llm

  89 16,622 9.9 Python llama.cpp VS mlc-llm

  Enable everyone to develop, optimize and deploy AI models natively on everyone's devices.

  

• guidance

  89 12,248 9.5 Jupyter Notebook llama.cpp VS guidance

  Discontinued A guidance language for controlling large language models. [Moved to: https://github.com/guidance-ai/guidance] (by microsoft)

  

• FastChat

  82 33,464 9.7 Python llama.cpp VS FastChat

  An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

  

• LocalAI

  82 19,033 9.9 C++ llama.cpp VS LocalAI

  :robot: The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. It allows to generate Text, Audio, Video, Images. Also with voice cloning capabilities.

  

• GPTQ-for-LLaMa

  75 2,904 8.6 Python llama.cpp VS GPTQ-for-LLaMa

  4 bits quantization of LLaMA using GPTQ

• ggml

  69 9,566 9.8 C llama.cpp VS ggml

  Tensor library for machine learning

• exllama

  64 2,566 9.0 Python llama.cpp VS exllama

  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.

• llama-cpp-python

  54 6,280 9.9 Python llama.cpp VS llama-cpp-python

  Python bindings for llama.cpp

• StableLM

  43 15,848 5.0 Jupyter Notebook llama.cpp VS StableLM

  StableLM: Stability AI Language Models

  

• llm

  41 5,842 9.4 Rust llama.cpp VS llm

  An ecosystem of Rust libraries for working with large language models

  

• llamafile

  33 13,290 9.6 C++ llama.cpp VS llamafile

  Distribute and run LLMs with a single file.

  

• SaaSHub

  www.saashub.com

  sponsored

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives