Top 23 Go LLM Projects

LLM

• Add a project

1. ollama

   1 885 182,067 9.8 Go

   Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

   

   Project mention: I Built My Friend a Mock Interviewer That Read His Rust Code | dev.to | 2026-10-05

   Gemma, Google's open-weight model, served by Ollama on localhost.

2. AppSignal

   www.appsignal.com sponsored

   Monitoring that respects your time & budget. APM, error tracking, and dashboards for modern web apps. Ten-minute setup, transparent flat pricing, and support from engineers who actually use the product.

   

3. caveman

   2 43 108,610 9.8 Go

   🪨 why use many token when few token do trick. Viral skill + proxy for coding agents that cuts 65% of tokens by talking like a caveman.

   

   Project mention: Caveman: Make Your AI Coding Agent Talk Less (and Save Tokens) | dev.to | 2026-10-02

   Repo: github.com/JuliusBrussee/caveman

4. ragflow

   3 20 91,595 10.0 Go

   RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs

   

   Project mention: Open Source Highlights September 2026: 7 Projects You Should Know | dev.to | 2026-09-19

   github.com/infiniflow/ragflow

5. LocalAI

   4 98 49,371 10.0 Go

   LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

   

   Project mention: 20 GitHub Repositories to Build with AI | dev.to | 2026-09-29

   LocalAI lets you run AI models on your own hardware and provides an API that is compatible with many OpenAI API use cases.

6. Milvus

   5 140 46,314 10.0 Go

   Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

   

   Project mention: Vector Database Memory Sizing and Cost Math: How Much RAM Do 1 Million Vectors Need? | dev.to | 2026-10-04

   Milvus likewise exposes separate mmap controls in its official configuration for vector fields and vector indexes. These features do not guarantee ‘the same performance with 10× less RAM’. Once the working set exceeds memory, page faults, disk queues, and tail latency can grow. The defensible claim is that dedicated engines offer finer resident-versus-disk placement; the achieved ratio depends on the SSD, query distribution, and quality target.

7. DeepSeek-Reasonix

   6 4 35,729 10.0 Go

   A reliable coding agent for complex software engineering tasks.

   

   Project mention: Show HN: Sunk Cost – How long until a local LLM rig pays for itself? | news.ycombinator.com | 2026-09-14

   Regarding DeepSeek, which I also like very much, have you tried https://reasonix.io ?

8. WeKnora

   7 1 31,580 10.0 Go

   Open-source LLM knowledge platform: turn raw documents into a queryable RAG, an autonomous reasoning agent, and a self-maintaining Wiki.

   

   Project mention: WeKnora – LLM-Powered Document Understanding and Retrieval Framework | news.ycombinator.com | 2025-12-14

9. SaaSHub

   www.saashub.com sponsored

   SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

   

10. gitleaks

    8 65 29,633 6.1 Go

    Find secrets with Gitleaks 🔑

    

    Project mention: How to audit your codebase for exposed API keys (free tools) | dev.to | 2026-10-05

    # Install (macOS) brew install gitleaks # Install (Linux) curl -sSL https://github.com/gitleaks/gitleaks/releases/latest/download/gitleaks_linux_x64.tar.gz | tar -xz sudo mv gitleaks /usr/local/bin/ # Scan full git history of the current repo gitleaks detect --source . --verbose # Write a JSON report gitleaks detect --source . --report-path gitleaks-report.json --report-format json

11. kubesphere

    9 12 17,059 7.5 Go

    The container platform tailored for Kubernetes multi-cloud, datacenter, and edge management ⎈ 🖥 ☁️

    

    Project mention: Deploy KubeSphere and Kubernetes on Amazon EC2 in All in One Mode | dev.to | 2026-09-06

    ##################################################### ### Welcome to KubeSphere! ### ##################################################### Console: http://172.31.38.43:30880 Account: admin Password: P@88w0rd NOTES： 1. After you log into the console, please check the monitoring status of service components in "Cluster Management". If any service is not ready, please wait patiently until all components are up and running. 2. Please change the default password after login. ##################################################### https://kubesphere.io 2023-11-19 05:43:59 ##################################################### 05:44:00 UTC success: [kubesphere-master] 05:44:00 UTC Pipeline[CreateClusterPipeline] execute successfully Installation is complete. Please check the result using the command: kubectl logs -n kubesphere-system $(kubectl get pod -n kubesphere-system -l 'app in (ks-install, ks-installer)' -o jsonpath='{.items[0].metadata.name}') -f

12. plandex

    10 43 15,688 9.7 Go

    Open source AI coding agent. Designed for large projects and real world tasks.

    

13. mcp-toolbox

    11 6 14,073 - Go

    MCP Toolbox for Databases is an open source MCP server for databases.

    

    Project mention: Four vendors, one bad assumption: SSRF in MCP servers | dev.to | 2026-09-28

    Google fix, googleapis/mcp-toolbox PR #3448

14. adk-go

    12 9 8,839 9.6 Go

    An open-source, code-first Go toolkit for building, evaluating, and deploying sophisticated AI agents with flexibility and control.

    

    Project mention: Go LLM SDK for streaming, tool-calling AI back ends plus front end | news.ycombinator.com | 2026-07-30

    ADK seems like a better thought through SDK family, I use Go, Py is most mature, also TS and Java. The docs still need a lot of work to cover all the languages, it's pretty hit or miss right now, but one can also have a coding agent look at the source and an example for another language.

    https://adk.dev/get-started/about/ | https://github.com/google/adk-go

15. bifrost

    13 157 8,535 10.0 Go

    Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.

    

    Project mention: Top 5 Enterprise AI Gateways (2026): Bifrost vs Kong vs LiteLLM vs Cloudflare vs Vercel | dev.to | 2026-10-01

    It cannot. You are choosing between the self-hosted three. If Kong already runs your APIs, extend it. If you want the fastest gateway with governance and MCP in the open-source tier, pick Bifrost. If you are Python-first and value provider breadth over throughput, LiteLLM works, as long as you scale workers, pin versions and fix the retry defaults.

16. flyte

    14 39 7,619 9.7 Go

    Type-safe, distributed orchestration of agents, ML pipelines, and real-time inference on your k8s — in pure Python with async/await, also other languages (rust, go and ts)

    

17. osmedeus

    15 2 6,593 8.5 Go

    A Modern Orchestration Engine for Security

    

18. semantic-router

    16 1 6,012 9.9 Go

    A programmable Mixture-of-Models router for heterogeneous LLM inference (by vllm-project)

    

    Project mention: Show HN: Smart model routing directly in Claude, Codex and Cursor | news.ycombinator.com | 2026-06-26

19. openagent

    17 7 5,680 9.8 Go

    ⚡️next-generation personal AI assistant powered by LLM, RAG and agent loops, supporting computer-use, browser-use and coding agent, demo: https://demo.openagentai.org

    

    Project mention: I Built a Single-File AI Agent in Go — Zero Dependencies, Double-Click to Run | dev.to | 2026-05-18

    GitHub: github.com/the-open-agent/openagent ⭐

20. deepflow

    18 6 4,286 9.6 Go

    eBPF Observability - Distributed Tracing and Profiling

    

21. goclaw

    19 3 3,638 9.9 Go

    GoClaw - GoClaw is OpenClaw rebuilt in Go — with multi-tenant isolation, 5-layer security, and native concurrency. Deploy AI agent teams at scale without compromising on safety.

    

    Project mention: 🔮 Hermes Agent 🤖: The Self-Improving Agent Framework — and How It Compares to OpenClaw & GoClaw 📊 | dev.to | 2026-05-18

    ⚔️ How it compares with two adjacent open-source projects: OpenClaw and GoClaw — when to pick which

22. OM1

    20 2 2,941 9.6 Go

    Modular AI HAL (Hardware Abstraction Layer) for Robots

    

    Project mention: Google stole open source code without crediting the authors (Artemis/Minitap) | news.ycombinator.com | 2026-09-11

23. paperless-gpt

    21 3 2,724 8.6 Go

    Use LLMs and LLM Vision (OCR) to handle paperless-ngx - Document Digitalization powered by AI

    

    Project mention: paperless-gpt VS paperless starfruit - a user suggested alternative | libhunt.com/r/paperless-gpt | 2026-07-19

24. trainer

    22 2 2,236 9.7 Go

    Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

    

25. beelzebub

    23 42 2,189 8.7 Go

    A secure low code deception runtime framework, leveraging AI for System Virtualization.

    

26. SaaSHub

    www.saashub.com sponsored

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    

Go LLM related posts

• Saathi - a help application

  2 projects | dev.to | 5 Oct 2026

• SafePlate AI - Open-Source Local Allergy Shield for My Friend Swayum

  2 projects | dev.to | 4 Oct 2026

• I built my friend a Spanish tutor that runs on her laptop and never phones home

  1 project | dev.to | 4 Oct 2026

• First Light: The Privacy-First Morning Brief & Radar for Hackathon Hunters

  2 projects | dev.to | 4 Oct 2026

• I Built an Offline AI Accounts Book for My Father's Business

  2 projects | dev.to | 4 Oct 2026

• LeetBuddy: Your AI Coding Buddy for LeetCode

  2 projects | dev.to | 4 Oct 2026

• Spar with a Friend

  2 projects | dev.to | 4 Oct 2026
• A note from our sponsor - SaaSHub
  www.saashub.com | 5 Oct 2026

  SaaSHub helps you find the best software and product alternatives Learn more →

Index

Sponsored

Monitoring that respects your time & budget

APM, error tracking, and dashboards for modern web apps. Ten-minute setup, transparent flat pricing, and support from engineers who actually use the product.

www.appsignal.com

Do not miss the trending Go projects with our weekly report!