SaaSHub helps you find the best software and product alternatives Learn more →
Top 23 Go LLM Projects
-
ollama
Get up and running with Kimi-K2.6, GLM-5.1, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
Project mention: LLM Quantization Levels Compared: Q4_K_M vs Q8_0 vs FP16 [2026] | dev.to | 2026-07-05To see available tags for any model, check the model page on ollama.com or run ollama show llama3 --modelfile to inspect what you currently have.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
ragflow
RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs
Project mention: I Scanned 5 Popular Open-Source AI Projects for EU AI Act Compliance. Here's What I Found. | dev.to | 2026-03-31I ran AIR Blackbox (the scanner itself), Browser Use (79K+ stars), RAGFlow (76K+ stars), LiteLLM (23K+ stars), and Superlinked (15K+ stars) through the same compliance checks.
-
LocalAI
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
LocalAI: https://github.com/mudler/LocalAI
-
Milvus
Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search
Milvus: Optimized for large-scale, distributed memory operations
-
Representative tools: Gitleaks and TruffleHog are the open-source workhorses. Run both through the pre-commit framework so secrets get caught before they ever hit the remote.
-
DeepSeek-Reasonix
DeepSeek-native AI coding agent for your terminal. Engineered around prefix-cache stability — leave it running.
Project mention: DeepSeek open-sources inference optimizations with 60–85% faster generation [pdf] | news.ycombinator.com | 2026-06-27Have you tried reasonix?
https://github.com/esengine/deepseek-reasonix
-
WeKnora
Open-source LLM knowledge platform: turn raw documents into a queryable RAG, an autonomous reasoning agent, and a self-maintaining Wiki.
Project mention: WeKnora – LLM-Powered Document Understanding and Retrieval Framework | news.ycombinator.com | 2025-12-14 -
kubesphere
The container platform tailored for Kubernetes multi-cloud, datacenter, and edge management ⎈ 🖥 ☁️
Project mention: kubesphere VS kite - a user suggested alternative | libhunt.com/r/kubesphere | 2025-07-31 -
https://github.com/plandex-ai/plandex/blob/9017ba33a627c518a...
This line tells me your code isn't running within a company with a large number of active users. A limitless select * to get Auth tokens from a database is one of those things that breaks at scale.
-
数据来源：googleapis/mcp-toolbox — 15,240 ⭐，executeautomation/mcp-playwright — 5,514 ⭐
-
adk-go
An open-source, code-first Go toolkit for building, evaluating, and deploying sophisticated AI agents with flexibility and control.
Project mention: Go for AI Agents: Why the Language Choice Matters at Production Scale | dev.to | 2026-03-04This week Google open-sourced adk-go — a Go port of their Agent Development Kit. The Hacker News thread that followed racked up ~150 points and surfaced something worth examining: a growing, serious argument that Go is better suited than Python for production AI agent infrastructure.
-
flyte
Dynamic, resilient AI orchestration. Coordinate data, models, and compute as you build AI workflows.
-
-
bifrost
Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.
-
openagent
⚡️next-generation personal AI assistant powered by LLM, RAG and agent loops, supporting computer-use, browser-use and coding agent, demo: https://demo.openagentai.org
Project mention: I Built a Single-File AI Agent in Go — Zero Dependencies, Double-Click to Run | dev.to | 2026-05-18GitHub: github.com/the-open-agent/openagent ⭐
-
semantic-router
System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge (by vllm-project)
Project mention: Show HN: Smart model routing directly in Claude, Codex and Cursor | news.ycombinator.com | 2026-06-26 -
-
ClaraVerse
Claraverse is a opesource privacy focused ecosystem to replace ChatGPT, Claude, N8N, ImageGen with your own hosted llm, keys and compute. With desktop, IOS, Android Apps.
-
goclaw
GoClaw - GoClaw is OpenClaw rebuilt in Go — with multi-tenant isolation, 5-layer security, and native concurrency. Deploy AI agent teams at scale without compromising on safety.
Project mention: 🔮 Hermes Agent 🤖: The Self-Improving Agent Framework — and How It Compares to OpenClaw & GoClaw 📊 | dev.to | 2026-05-18⚔️ How it compares with two adjacent open-source projects: OpenClaw and GoClaw — when to pick which
-
-
paperless-gpt
Use LLMs and LLM Vision (OCR) to handle paperless-ngx - Document Digitalization powered by AI
Project mention: ScribeOCR – Web interface for recognizing text, OCR, & creating digitized docs | news.ycombinator.com | 2025-10-06 -
-
Project mention: Show HN: Beelzebub (OSS) – MCP "canary tools" for AI agents | news.ycombinator.com | 2025-09-07
We’re open-sourcing a simple way to add “canary tools” to AI agents via MCP honeypots. These are functions your agent should never call during normal operation. If a canary is invoked, you get a high-fidelity signal of prompt-injection, tool hijacking, or lateralization—no heuristics, no extra model calls.
What it is:
- Go framework exposing decoy tools over MCP that look legitimate (names/params/descriptions), return safe dummy output, and emit telemetry when invoked.
- Runs alongside your real tools; ship events to stdout/webhook or your pipeline (Prometheus/Grafana, ELK).
Why it helps:
Agent logs show what happened; canaries mark what must not happen. A single tripwire is an immediate, low-noise indicator of compromise.
Real-world relevance (Nx attack):
Recent reporting on the Nx npm supply-chain incident (“s1ngularity”) shows malicious versions exfiltrated SSH keys, tokens, and other secrets—and notably abused AI developer tools like Claude/Gemini in the workflow, one of the first documented cases of AI assistants being weaponized in a software supply-chain attack. If your IDE agent (Claude Code or Gemini Code/CLI) had a canary tool registered—e.g., a fake “export secrets” or “repo exfil” action—any unauthorized tool call from the agent side would have triggered a deterministic alert during that incident.
Links:
GitHub: https://github.com/mariocandela/beelzebub
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
Go LLM discussion
Go LLM related posts
-
New AI tutor achieves 0.71-1.30 SD effect size in Dartmouth course [pdf]
-
Show HN: Fastest Enterprise AI Gateway
-
My commit message said "You've hit your session limit"
-
How I Run My Content Tooling on a Local Model for $0
-
How I Replaced Gemini with a Self-Hosted LLM for Two Production Apps
-
Run isolated sandboxes with full lifecycle control: AWS introduces MicroVMs
-
Llama.cpp flags auto-tuning tool
-
A note from our sponsor - SaaSHub
www.saashub.com | 10 Jul 2026
Index
What are some of the best open-source LLM projects in Go? This list will help you:
| # | Project | Stars |
|---|---|---|
| 1 | ollama | 175,880 |
| 2 | ragflow | 84,711 |
| 3 | LocalAI | 47,307 |
| 4 | Milvus | 45,068 |
| 5 | gitleaks | 27,987 |
| 6 | DeepSeek-Reasonix | 26,538 |
| 7 | WeKnora | 17,990 |
| 8 | kubesphere | 16,992 |
| 9 | plandex | 15,510 |
| 10 | mcp-toolbox | 14,073 |
| 11 | adk-go | 8,432 |
| 12 | flyte | 7,128 |
| 13 | osmedeus | 6,459 |
| 14 | bifrost | 6,255 |
| 15 | openagent | 5,371 |
| 16 | semantic-router | 4,766 |
| 17 | deepflow | 4,172 |
| 18 | ClaraVerse | 3,836 |
| 19 | goclaw | 3,411 |
| 20 | OM1 | 2,871 |
| 21 | paperless-gpt | 2,496 |
| 22 | trainer | 2,134 |
| 23 | beelzebub | 2,078 |
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com