Llama.cpp Alternatives

Similar projects and alternatives to llama.cpp

• llama.cpp

  775 57,463 10.0 C++ llama.cpp VS llama.cpp

  LLM inference in C/C++

• whisper.cpp

  187 31,426 9.8 C llama.cpp VS whisper.cpp

  Port of OpenAI's Whisper model in C/C++

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• mlc-llm

  89 17,053 9.9 Python llama.cpp VS mlc-llm

  Enable everyone to develop, optimize and deploy AI models natively on everyone's devices.

  

• exllama

  64 2,609 9.0 Python llama.cpp VS exllama

  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.

• lit-llama

  23 5,814 8.4 Python llama.cpp VS lit-llama

  Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

  

• darknet

  22 25,319 0.0 C llama.cpp VS darknet

  Convolutional Neural Networks

• serving

  12 6,079 9.8 C++ llama.cpp VS serving

  A flexible, high-performance serving system for machine learning models

  

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

• flake

  5 593 4.4 Nix llama.cpp VS flake

  A Nix flake for many AI projects

  

• llama_cpp.rb

  2 143 9.6 C++ llama.cpp VS llama_cpp.rb

  llama_cpp provides Ruby bindings for llama.cpp

• TokenHawk

  1 98 10.0 C++ llama.cpp VS TokenHawk

  Discontinued WebGPU LLM inference tuned by hand [Moved to: https://github.com/kayvr/token-hawk]