llama.cpp

LLM inference in C/C++ (by fairydreaming)

Llama.cpp Alternatives

Similar projects and alternatives to llama.cpp

  1. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better llama.cpp alternative or higher similarity.

llama.cpp discussion

Log in or Post with

llama.cpp reviews and mentions

Posts with mentions or reviews of llama.cpp. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2026-07-07.
  • GLM 5.2 and the coming AI margin collapse
    2 projects | news.ycombinator.com | 7 Jul 2026
    Different sessions. With https://github.com/fairydreaming/llama.cpp/tree/dsv4, 1M context with DSV4 Flash takes less than 6GB of VRAM. I can't run DSV4 Pro, but it should take less than 9GB of VRAM for 1M context, based on the numbers shared in https://arxiv.org/html/2606.19348v1.

Stats

Basic llama.cpp repo stats
1
27
-
12 days ago

fairydreaming/llama.cpp is an open source project licensed under MIT License which is an OSI approved license.

The primary programming language of llama.cpp is C++.


Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com

Did you know that C++ is
the 7th most popular programming language
based on number of references?