Alpaca.cpp Alternatives

Similar projects and alternatives to alpaca.cpp

• text-generation-webui

  876 35,862 9.9 Python alpaca.cpp VS text-generation-webui

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

• llama.cpp

  769 55,846 10.0 C++ alpaca.cpp VS llama.cpp

  LLM inference in C/C++

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• whisper.cpp

  187 30,942 9.8 C alpaca.cpp VS whisper.cpp

  Port of OpenAI's Whisper model in C/C++

• koboldcpp

  180 3,749 10.0 C++ alpaca.cpp VS koboldcpp

  A simple one-file way to run various GGML and GGUF models with KoboldAI's UI

• gpt4all

  139 64,046 9.8 C++ alpaca.cpp VS gpt4all

  gpt4all: run open-source LLMs anywhere

  

• alpaca-lora

  107 18,167 3.6 Jupyter Notebook alpaca.cpp VS alpaca-lora

  Instruct-tune LLaMA on consumer hardware

• stanford_alpaca

  108 28,761 2.0 Python alpaca.cpp VS stanford_alpaca

  Code and documentation to train Stanford's Alpaca models, and generate the data.

  

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• RWKV-LM

  84 11,619 8.8 Python alpaca.cpp VS RWKV-LM

  RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.

• FastChat

  82 33,668 9.7 Python alpaca.cpp VS FastChat

  An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

  

• LocalAI

  82 19,593 9.9 C++ alpaca.cpp VS LocalAI

  :robot: The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. It allows to generate Text, Audio, Video, Images. Also with voice cloning capabilities.

  

• GPTQ-for-LLaMa

  75 2,904 8.6 Python alpaca.cpp VS GPTQ-for-LLaMa

  4 bits quantization of LLaMA using GPTQ

• dalai

  59 13,044 6.5 CSS alpaca.cpp VS dalai

  The simplest way to run LLaMA on your local machine

• llm

  41 5,885 9.4 Rust alpaca.cpp VS llm

  An ecosystem of Rust libraries for working with large language models

  

• serge

  40 5,535 9.8 Svelte alpaca.cpp VS serge

  A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.

  

• ChatRWKV

  28 9,276 8.3 Python alpaca.cpp VS ChatRWKV

  ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.

• codealpaca

  20 1,373 4.4 Python alpaca.cpp VS codealpaca

• ChatGLM-6B

  17 39,231 8.4 Python alpaca.cpp VS ChatGLM-6B

  ChatGLM-6B: An Open Bilingual Dialogue Language Model | 开源双语对话语言模型

  

• rwkv.cpp

  12 1,097 7.6 C++ alpaca.cpp VS rwkv.cpp

  INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model

  

• llamacpp-for-kobold

  8 96 10.0 C alpaca.cpp VS llamacpp-for-kobold

  Discontinued Port of Facebook's LLaMA model in C/C++ [Moved to: https://github.com/LostRuins/koboldcpp]

• coral-pi-rest-server

  44 66 0.0 Jupyter Notebook alpaca.cpp VS coral-pi-rest-server

  Perform inferencing of tensorflow-lite models on an RPi with acceleration from Coral USB stick

• SaaSHub

  www.saashub.com sponsored

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives