SaaSHub helps you find the best software and product alternatives Learn more โ
Top 23 LLM Open-Source Projects
-
AutoGPT
AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.
AutoGPT (agpt.co): Open-source autonomous agent framework, released in 2023. Pioneering example of general-purpose agent architecture; known for demonstrating both promise and limitations of autonomous systems.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
ollama
Get up and running with Kimi-K2.6, GLM-5.1, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
Project mention: Grammarly costs $12/mo โ a local LLM does it for free (Chrome + Ollama) | dev.to | 2026-06-15The thing is, the AI isn't the hard part anymore. Anyone can run a capable model locally with Ollama in two commands, for free. What's missing is the interface. The reason Grammarly was worth paying for was never the grammar engine โ it was the friendly diff that lets you see and control each change.
-
transformers
๐ค Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
Project mention: The $100 ChatGPT: Why Karpathy's nanochat Represnts the Next Big Thing | dev.to | 2026-05-04Hugging Face Transformers: 500,000+ lines
-
git clone https://github.com/langgenius/dify.git cd dify/docker cp .env.example .env docker compose up -d
-
Project mention: Quick and easy local AI RAG setup with JetBrains IDE integration and browser UI | dev.to | 2026-06-02
To get a local web UI (that is very similar to CharGPT) that supports Retrieval Augmented Generation (RAG), workflows and many other features, we'll use Open WebUI (https://github.com/open-webui/open-webui). Although it can be setup using locally installed Python, I've decided to try out their Docker image instead. Since I have an Nvidia card, I've used their Nvidia GPU supported docker image.
-
Project mention: How to Use an AI Agent โ Build a Working Agent Team in Three Steps | dev.to | 2026-06-12
How do you use an AI Agent? Three steps: pick a platform โ define the Agent โ run and iterate. The core formula โ define the role, set the goal, connect the tools, draw the red lines. Developers build with LangChain; non-technical teams drag and drop on SoloEngine. You can have an Agent up and running in 5 minutes. Tech isn't the barrier โ clearly defining your Agent is.
-
generate-lander.ts โ This is the interesting one. It uses Anthropic + Firecrawl to scrape a partner's website, then generates a custom landing page for their affiliate program. Automated partner onboarding.
-
browser-use
Open-source browser automation framework for AI agents. Browser Use lets AI agents control real browser sessions to complete multi-step web workflows.
browser-use: https://github.com/browser-use/browser-use
-
-
Project mention: Serverless GPU Inference: Deploy Any Hugging Face Model on Google Cloud Run | dev.to | 2026-06-15
That endpoint is real. An NVIDIA L4 GPU on Cloud Run, running vLLM (best open source way to serve LLMs) OpenAI-compatible API. Four commands to get there:
-
ragflow
RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs
Project mention: I Scanned 5 Popular Open-Source AI Projects for EU AI Act Compliance. Here's What I Found. | dev.to | 2026-03-31I ran AIR Blackbox (the scanner itself), Browser Use (79K+ stars), RAGFlow (76K+ stars), LiteLLM (23K+ stars), and Superlinked (15K+ stars) through the same compliance checks.
-
A hands-on, end-to-end course on building, evaluating, and deploying LLM applications. Ideal when you want a clear path from spark of an idea to deployment. Link: https://github.com/mlabonne/llm-course
-
OpenHands AGENTS.md
-
Project mention: Llama-Factory: Unified, Efficient Fine-Tuning for 100 Open LLMs | news.ycombinator.com | 2025-09-18
-
caveman
๐ชจ why use many token when few token do trick โ Claude Code skill that cuts 65% of tokens by talking like caveman
-
deer-flow
An open-source long-horizon SuperAgent harness that researches, codes, and creates. With the help of sandboxes, memories, tools, skill, subagents and message gateway, it handles different levels of tasks that could take minutes to hours.
Tools have been trending in this direction for the last 3-6 months with features like "Assign to Copilot" in GitHub.com, and the Linear's work tracking system where its unique sales pitch is "write tickets for agents to work on here". The final form of this kind of solution is currently a vague, but there are several projects already pitching to own this space such as Open AI's Symphony project (https://openai.com/index/open-source-codex-orchestration-symphony/), ByteDance's DeerFlow (https://github.com/bytedance/deer-flow) which pitches itself as "an open-source super-agent harness", and other similar projects.
-
MetaGPT
๐ The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming
Project mention: Backlog.md โ CLI that auto-generates task files (took my Claude success to 95 %) | news.ycombinator.com | 2025-07-06 -
unsloth
Unsloth Studio is a web UI for training and running open models like Gemma 4, Qwen3.6, DeepSeek, gpt-oss locally.
Project mention: I Trained an LLM on 75K of My Own Messages So It Would Stop Writing Like a Chatbot | dev.to | 2026-05-08Training: unsloth + trl (SFTTrainer). Unsloth handles the 4-bit quantization and gradient checkpointing; trl handles the training loop.
-
anything-llm
Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience
Project mention: NVIDIA RTX Spark: What the Backlash Gets Wrong About AI on Your Desktop [2026] | dev.to | 2026-06-04The headline marketing number is "1 petaflop" of AI performance. Sounds staggering. Tim Carambat, creator of AnythingLLM and one of the most credible voices in the local AI developer community, has already questioned this figure. His point is one I've validated repeatedly in my own benchmarking: for running large language models locally, memory bandwidth is the actual bottleneck, not raw FLOPS. You can have all the tensor cores in the world, but if you can't feed them data fast enough, your Llama 3 inference is still going to crawl.
-
llm-app
Ready-to-run cloud templates for RAG, AI pipelines, and enterprise search with live data. ๐ณDocker-friendly.โกAlways in sync with Sharepoint, Google Drive, S3, Kafka, PostgreSQL, real-time data APIs, and more.
-
Agents need to compress work into state. [10] Mem0 positions memory inside the harness alongside tools and coordination. [11] [17]
-
Project mention: I got tired of copy-pasting GitHub issues into AI chats. So I fixed it. | dev.to | 2026-04-10
What really inspired this was Context7. Watching it fetch fresh docs as a subagent made something click:
-
That let to MemPalace, or https://mempalaceofficial.com/ (hopefully, that's the right one!)
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
LLM discussion
LLM related posts
-
Grammarly costs $12/mo โ a local LLM does it for free (Chrome + Ollama)
-
Serverless GPU Inference: Deploy Any Hugging Face Model on Google Cloud Run
-
A 9-point eval gain vanished when we deduped train against test
-
Show HN: Dream Server โ Turn your PC, Mac, or Linux box into a private AI server
-
AI Pair Programming in Your Terminal with Aider and Ollama
-
Build a Private AI App Platform with Dify and Ollama
-
SillyTavern provides a single unified interface for many LLM APIs
-
A note from our sponsor - SaaSHub
www.saashub.com | 15 Jun 2026
Index
What are some of the best open-source LLM projects? This list will help you:
| # | Project | Stars |
|---|---|---|
| 1 | AutoGPT | 184,885 |
| 2 | ollama | 173,924 |
| 3 | transformers | 161,558 |
| 4 | dify | 144,696 |
| 5 | open-webui | 140,988 |
| 6 | langchain | 139,168 |
| 7 | firecrawl | 131,844 |
| 8 | browser-use | 98,375 |
| 9 | LLMs-from-scratch | 96,979 |
| 10 | vllm | 82,489 |
| 11 | ragflow | 82,474 |
| 12 | llm-course | 80,074 |
| 13 | OpenHands | 76,575 |
| 14 | LlamaFactory | 72,081 |
| 15 | caveman | 71,068 |
| 16 | deer-flow | 70,969 |
| 17 | MetaGPT | 68,683 |
| 18 | unsloth | 66,397 |
| 19 | anything-llm | 61,470 |
| 20 | llm-app | 59,332 |
| 21 | mem0 | 58,292 |
| 22 | context7 | 57,203 |
| 23 | mempalace | 55,376 |
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com