alpaca.cpp

Locally run an Instruction-Tuned Chat-Style LLM (by antimatter15)

Alpaca.cpp Alternatives

Similar projects and alternatives to alpaca.cpp

  1. llama.cpp

    LLM inference in C/C++

  2. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  3. textgen

    887 alpaca.cpp VS textgen

    Open-source desktop app for local LLMs. Text, vision, tool-calling, OpenAI/Anthropic-compatible API. 100% private.

  4. whisper.cpp

    Port of OpenAI's Whisper model in C/C++

  5. koboldcpp

    Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

  6. gpt4all

    GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

  7. stanford_alpaca

    Code and documentation to train Stanford's Alpaca models, and generate the data.

  8. alpaca-lora

    107 alpaca.cpp VS alpaca-lora

    Instruct-tune LLaMA on consumer hardware

  9. LocalAI

    LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

  10. FastChat

    86 alpaca.cpp VS FastChat

    An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

  11. RWKV-LM

    86 alpaca.cpp VS RWKV-LM

    RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

  12. GPTQ-for-LLaMa

    4 bits quantization of LLaMA using GPTQ

  13. dalai

    59 alpaca.cpp VS dalai

    The simplest way to run LLaMA on your local machine

  14. llm

    41 alpaca.cpp VS llm

    Discontinued [Unmaintained, see README] An ecosystem of Rust libraries for working with large language models (by rustformers)

  15. serge

    40 alpaca.cpp VS serge

    A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.

  16. ChatRWKV

    28 alpaca.cpp VS ChatRWKV

    ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.

  17. ChatGLM-6B

    17 alpaca.cpp VS ChatGLM-6B

    ChatGLM-6B: An Open Bilingual Dialogue Language Model | 开源双语对话语言模型

  18. rwkv.cpp

    INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model

  19. llamacpp-for-kobold

    Discontinued Port of Facebook's LLaMA model in C/C++ [Moved to: https://github.com/LostRuins/koboldcpp]

  20. coral-pi-rest-server

    Perform inferencing of tensorflow-lite models on an RPi with acceleration from Coral USB stick

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better alpaca.cpp alternative or higher similarity.

alpaca.cpp discussion

Log in or Post with

alpaca.cpp reviews and mentions

Posts with mentions or reviews of alpaca.cpp. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2024-03-31.

Stats

Basic alpaca.cpp repo stats
94
9,878
9.4
about 3 years ago

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com

Did you know that C is
the 6th most popular programming language
based on number of references?