alpaca.cpp

Locally run an Instruction-Tuned Chat-Style LLM (by antimatter15)

Alpaca.cpp Alternatives

Similar projects and alternatives to alpaca.cpp

  1. llama.cpp

    LLM inference in C/C++

  2. InfluxDB

    InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.

    InfluxDB logo
  3. text-generation-webui

    A Gradio web UI for Large Language Models with support for multiple inference backends.

  4. whisper.cpp

    Port of OpenAI's Whisper model in C/C++

  5. koboldcpp

    Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

  6. gpt4all

    GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

  7. stanford_alpaca

    Code and documentation to train Stanford's Alpaca models, and generate the data.

  8. alpaca-lora

    107 alpaca.cpp VS alpaca-lora

    Instruct-tune LLaMA on consumer hardware

  9. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  10. LocalAI

    :robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference

  11. FastChat

    86 alpaca.cpp VS FastChat

    An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

  12. RWKV-LM

    85 alpaca.cpp VS RWKV-LM

    RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

  13. GPTQ-for-LLaMa

    4 bits quantization of LLaMA using GPTQ

  14. dalai

    59 alpaca.cpp VS dalai

    The simplest way to run LLaMA on your local machine

  15. llm

    41 alpaca.cpp VS llm

    Discontinued [Unmaintained, see README] An ecosystem of Rust libraries for working with large language models (by rustformers)

  16. serge

    40 alpaca.cpp VS serge

    A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.

  17. ChatRWKV

    28 alpaca.cpp VS ChatRWKV

    ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.

  18. ChatGLM-6B

    17 alpaca.cpp VS ChatGLM-6B

    ChatGLM-6B: An Open Bilingual Dialogue Language Model | 开源双语对话语言模型

  19. rwkv.cpp

    INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model

  20. llamacpp-for-kobold

    Discontinued Port of Facebook's LLaMA model in C/C++ [Moved to: https://github.com/LostRuins/koboldcpp]

  21. coral-pi-rest-server

    Perform inferencing of tensorflow-lite models on an RPi with acceleration from Coral USB stick

  22. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better alpaca.cpp alternative or higher similarity.

alpaca.cpp discussion

Log in or Post with

alpaca.cpp reviews and mentions

Posts with mentions or reviews of alpaca.cpp. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2024-03-31.

Stats

Basic alpaca.cpp repo stats
94
9,878
9.4
about 2 years ago

Sponsored
InfluxDB – Built for High-Performance Time Series Workloads
InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
www.influxdata.com