Llama.cpp Alternatives

Similar projects and alternatives to llama.cpp

• text-generation-webui

  21 4,178 9.8 Python llama.cpp VS text-generation-webui

  A gradio web UI for running Large Language Models like GPT-J 6B, OPT, GALACTICA, LLaMA, and Pygmalion.

• llama

  8 13,800 6.7 Python llama.cpp VS llama

  Inference code for LLaMA models

  

• InfluxDB

  www.influxdata.com

  sponsored

  Access the most powerful time series database as a service. Ingest, store, & analyze all types of time series data in a fully-managed, purpose-built database. Keep data forever with low-cost storage and superior data compression.

  

• alpaca.cpp

  7 6,226 10.0 C llama.cpp VS alpaca.cpp

  Locally run an Instruction-Tuned Chat-Style LLM

• GPTQ-for-LLaMa

  8 686 10.0 Python llama.cpp VS GPTQ-for-LLaMa

  4 bits quantization of LLaMa using GPTQ

• alpaca-lora

  8 3,958 10.0 Jupyter Notebook llama.cpp VS alpaca-lora

  Instruct-tune LLaMA on consumer hardware

• ggml

  3 872 10.0 C llama.cpp VS ggml

  Tensor library for machine learning

• stanford_alpaca

  8 10,860 10.0 Python llama.cpp VS stanford_alpaca

  Code and documentation to train Stanford's Alpaca models, and generate the data.

  

• SonarLint

  www.sonarlint.org

  sponsored

  Clean code begins in your IDE with SonarLint. Up your coding game and discover issues early. SonarLint is a free plugin that helps you find & fix bugs and security issues from the moment you start writing code. Install from your favorite IDE marketplace today.

  

• llama-rs

  6 1,699 10.0 Rust llama.cpp VS llama-rs

  Run LLaMA inference on CPU, with Rust 🦀🚀🦙

• Open-Assistant

  3 19,035 9.9 Python llama.cpp VS Open-Assistant

  OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.

  

• ChatGLM-6B

  4 7,434 10.0 Python llama.cpp VS ChatGLM-6B

  ChatGLM-6B：开源双语对话语言模型 | An Open Bilingual Dialogue Language Model

  

• llama-dl

  4 3,386 8.8 Shell llama.cpp VS llama-dl

  High-speed download of LLaMA, Facebook's 65B parameter GPT model

• rllama

  4 203 10.0 Rust llama.cpp VS rllama

  Rust+OpenCL+AVX2 implementation of LLaMA inference code

• rust-gpu

  - 5,768 9.1 Rust llama.cpp VS rust-gpu

  🐉 Making Rust a first-class language and ecosystem for GPU shaders 🚧

  

• dalai

  3 3,265 10.0 JavaScript llama.cpp VS dalai

  The simplest way to run LLaMA on your local machine

• whisper.cpp

  2 12,415 9.7 C llama.cpp VS whisper.cpp

  Port of OpenAI's Whisper model in C/C++

• tinygrad

  2 11,018 9.9 Python llama.cpp VS tinygrad

  You like pytorch? You like micrograd? You love tinygrad! ❤️

• basaran

  2 334 10.0 Python llama.cpp VS basaran

  Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models.

  

• askai

  2 67 10.0 TypeScript llama.cpp VS askai

  Command Line Interface for OpenAi ChatGPT (by yudax42)

• yal-discord-bot

  2 51 10.0 Python llama.cpp VS yal-discord-bot

  Yet Another LLaMA Discord Bot

• llama

  2 30 10.0 llama.cpp VS llama

  Inference code for LLaMA models (by gmorenz)

• SaaSHub

  www.saashub.com

  sponsored

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives