SaaSHub helps you find the best software and product alternatives Learn more →
Top 23 llama Open-Source Projects
-
Project mention: I built an offline AI listing writer for small sellers in Cameroon | dev.to | 2026-10-14
Ollama installed
-
AppSignal
Monitoring that respects your time & budget. APM, error tracking, and dashboards for modern web apps. Ten-minute setup, transparent flat pricing, and support from engineers who actually use the product.
-
Project mention: vLLM's --api-key leaves /invocations, /tokenize and /pause open. Lock it down with an allowlist proxy | dev.to | 2026-10-12
vLLM's guide says traffic between nodes (PyTorch distributed, KV-cache transfer, parallelism) is "insecure by default", and PyTorch's TCPStore listens on all interfaces. Keep multi-node setups on an isolated network and set VLLM_HOST_IP to the private address. If you run disaggregated serving with P2pNcclConnector on 0.9.2 to 0.23.x, update: GHSA-vfp2-c8pq-v6h6 let an X-Request-Id header leak KV-cache data, and the proxy above passes that header through.
-
unsloth
Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.
Unsloth (Faster Training)
-
-
Project mention: 5 Practical AI Coding Tricks Learned from Top GitHub Trending Agents | dev.to | 2026-09-28
If you’ve watched GitHub Trending over the past month, one shift is impossible to ignore: AI coding has moved from simple code completion to autonomous terminal agents like Aider, Cline, and Claude Code.
-
LocalAI
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
LocalAI lets you run AI models on your own hardware and provides an API that is compatible with many OpenAI API use cases.
-
AstrBot
AI Agent Assistant & development framework that integrates lots of IM platforms, LLMs, plugins and AI feature, and can be your openclaw alternative. ✨
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
Project mention: Context Language Models: What the UW and Meta Paper Changes for Agent Builders, and What It Leaves to Memory | dev.to | 2026-10-01 -
For anyone wondering “how slow is this?”
IIUC, Kimi K3 on RTX 6000 Ada (48GB) takes 292 s/token
https://github.com/lyogavin/airllm/releases/tag/v3.1.0
-
git clone https://github.com/fishaudio/fish-speech.git cd fish-speech pip install uv uv sync
-
repomix
📦 Repomix is a powerful tool that packs your entire repository into a single, AI-friendly file. Perfect for when you need to feed your codebase to Large Language Models (LLMs) or other AI tools like Claude, ChatGPT, DeepSeek, Perplexity, Gemini, Gemma, Llama, Grok, and more.
Project mention: One console.log disconnects your MCP server: the stdout bug every stdio server author hits | dev.to | 2026-09-27Real examples: esp-idf#19087, repomix#1866, keycloak-mcp#6.
-
LLaVA
[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
-
-
llama-cookbook
Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services
While people often focus on the big models, smaller and more specialised models are increasingly important. Codex for code generation, Stable Diffusion for images, and small LLaMA-class models for focused tasks are all good examples.
-
ChuanhuChatGPT
GUI for ChatGPT API and many LLMs. Supports agents, file-based QA, GPT finetuning and query with web search. All with a neat UI.
-
langchain4j
LangChain4j is an idiomatic, open-source Java library for building LLM-powered applications on the JVM. It offers a unified API over popular LLM providers and vector stores, and makes implementing tool calling (including MCP support), agents and RAG easy. It integrates seamlessly with enterprise Java frameworks like Quarkus and Spring Boot.
Project mention: Building a Multi-Agent Hiring Workflow with LangChain4j and LangGraph4j on Spring Boot | dev.to | 2026-08-05I wanted to actually learn LangChain4j and LangGraph4j beyond the "hello world" chat example, so I built something with enough moving parts to force real decisions: a hiring workflow where several AI agents independently score a candidate, a graph aggregates their opinions into a routing decision, and a human gets pulled in whenever the signals aren't clean. It's langchain4j-sample on Spring Boot, with LangGraph4j's Postgres checkpointer for state.
-
-
-
OpenLLM
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
-
shell_gpt
A command-line productivity tool powered by AI large language models like GPT-5, will help you accomplish your tasks faster and more efficiently.
-
Project mention: Run GGUF Models Easily with a KoboldAI UI. One File. Zero Install | news.ycombinator.com | 2026-06-27
-
-
llama-gpt
A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
according to [0] it looks like the "Umbrel Home" device they sell (with 16GB RAM and an N150 CPU) can run a 7B model at 2.7 tokens/sec, or a 13B model at 1.5 t/s.
especially when they seem to be aiming for a not-terribly-technical market segment, there seems to be a pretty big mismatch between that performance and their website claims:
> The most transformative technology of our generation shouldn't be confined to corporate data centers. Umbrel Home democratizes access to AI, allowing you to run powerful models on a device you own and control.
0: https://github.com/getumbrel/llama-gpt?tab=readme-ov-file#be...
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
llama discussion
llama related posts
-
I built an offline AI listing writer for small sellers in Cameroon
-
Handoff Proof: a local-Qwen evidence bundle for small Python AI apps
-
Building Bill Buddy MVP
-
BUILDING BILLBUDDY MVP
-
Focus Friend: An Executive Assistant Built for My Overwhelmed Friend Rahul
-
A receipt sorter that never leaves your laptop (Gemma + Ollama)
-
ReceiptGuard: A privacy-first, locally running invoice and receipt data extractor designed specifically for freelancers and solo-preneurs.
-
A note from our sponsor - SaaSHub
www.saashub.com | 14 Oct 2026
Index
What are some of the best open-source llama projects? This list will help you:
| # | Project | Stars |
|---|---|---|
| 1 | ollama | 182,543 |
| 2 | vllm | 93,391 |
| 3 | unsloth | 77,749 |
| 4 | LlamaFactory | 75,363 |
| 5 | aider | 49,467 |
| 6 | LocalAI | 49,463 |
| 7 | AstrBot | 41,611 |
| 8 | sglang | 36,916 |
| 9 | airllm | 35,924 |
| 10 | fish-speech | 32,972 |
| 11 | repomix | 28,740 |
| 12 | LLaVA | 24,972 |
| 13 | Chinese-LLaMA-Alpaca | 18,930 |
| 14 | llama-cookbook | 18,560 |
| 15 | ChuanhuChatGPT | 15,274 |
| 16 | langchain4j | 13,219 |
| 17 | PaddleNLP | 12,977 |
| 18 | dalai | 12,894 |
| 19 | OpenLLM | 12,553 |
| 20 | shell_gpt | 12,291 |
| 21 | koboldcpp | 11,980 |
| 22 | ludwig | 11,772 |
| 23 | llama-gpt | 10,940 |
Sponsored
Monitoring that respects your time & budget
APM, error tracking, and dashboards for modern web apps. Ten-minute setup, transparent flat pricing, and support from engineers who actually use the product.
www.appsignal.com