SaaSHub helps you find the best software and product alternatives Learn more →
Top 20 Go llm Projects
-
ollama
Get up and running with Kimi-K2.6, GLM-5.1, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
To solve these, we built a stack that prioritizes integrity over ease. The centerpiece is Ollama, running the mxbai-embed-large model locally. This is the engine that translates human thought into high-dimensional coordinates.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
-
chromem-go
Embeddable vector database for Go with Chroma-like interface and zero third-party dependencies. In-memory with optional persistence.
Yeah, wanting to try to do that.
Someone posted this recently: https://github.com/philippgille/chromem-go/tree/v0.7.0/examp...
But it is a very simplified RAG with only the lead paragraph to 200 Wikipedia entries.
I want to learn how to encode a RAG of one of the Kiwix drops — "Best of Wikipedia" for example. I suppose an LLM can tell me how but am surprised not to have yet stumbled upon one that someone has already done.
-
voice-ai
Rapida is an open-source, end-to-end voice AI orchestration platform for building real-time conversational voice agents with audio streaming, STT, TTS, VAD, multi-channel integration, agent state management, and observability.
Project mention: Open Source Real-Time Voice AI Infrastructure (Sip, Asterisk, WebRTC) | news.ycombinator.com | 2026-02-27 -
hof
A developer experience centered on CUE. Unifies schemas, data models, deterministic and agentic code generation, workflow and task engine, dagger powered environments, coding assistant, and vscode extension; woven together on the CUE lattice. Squint harder if you can't see the cube :]
The next step to this is using a better tool to access containers (BuildKit), like Dagger, where you can track every step as a new container layer, time travel, share via registries...
This has been my setup since early this year, not even that much code: https://github.com/hofstadter-io/hof/tree/_next/lib/agent/se...
The bigger effort is making it play nice with vscode so you can browse and edit the files and diffs.
-
aqueduct
Aqueduct is no longer being maintained. Aqueduct allows you to run LLM and ML workloads on any cloud infrastructure. (by RunLLM)
-
Project mention: Show HN: Orla, use lightweight, local, open-source agents as Unix tools | news.ycombinator.com | 2026-01-04
-
gateway
[deprecated] AI Gateway - core infrastructure stack for building production-ready AI Applications (by missingstudio)
-
dive
Use Dive to quickly build AI agents in Go. Build agentic CLIs or add AI to your backend Go services. Easily customized and embedded in larger applications. (by deepnoodle-ai)
https://github.com/diveagents/dive
Dive orchestrates multi agent workflows in Go. Take a look and let me know what you think.
-
Project mention: Show HN: Docker Alternative for Secure Microvms | news.ycombinator.com | 2026-04-03
Lately, I have been trying to understand the security aspect of docker containers, and what I have realized is that all docker containers share the host's kernel. Any zero day vulneerability in the kernel can be used to gain access to the host os.
In order to deal with this, I did some research turns out Amazon has open sourced the core technology behind their serverless technology lambda. But in its current state its very hard to setup, let alone run anything securly. This technology is called firecracker microvm's
It started off as a go library, for creating process pools to just do a simple firecracker spawn, turned into a full fledged host side daemon.
deploying and image container is now as simple as running
`herd deploy --image postgres:latest -p 5432:5432 -e POSTGRES_PASSWORD=postgres`
with boot times ~500ms
https://github.com/herd-core/herd
That brings us to today. I am looking for people to test this out and provide some feedback, I have been warned/cautioned by a lot of friends that building in isolation is a recipe for disaster.
PS: it only works on linux, macos doesn't have the required isolation, and I stopped caring about winslop.
-
Something similar but for any ACP server: https://github.com/inercia/mitto
-
raijin-mono
Raijin is an AI-powered terminal assistant in Go, with a fast TUI, multi-provider LLM support, and built-in tools and skills for coding workflows.
Project mention: Raijin – coding agent harness written in Go [MIT license] | news.ycombinator.com | 2026-02-25 -
brag
A command line tool for journaling daily accomplishments and summarizing them to create a bragging document.
-
-
Project mention: Show HN: Mother May I? – Auto-approve safe Bash commands in Claude Code | news.ycombinator.com | 2026-01-22
-
cmdfy
cmdfy is a command-line tool that translates natural language requests into executable shell commands.
Project mention: Show HN: Cmdfy – Generate shell commands locally using Ollama (Go binary) | news.ycombinator.com | 2026-01-30 -
proxy
Props AI provides this open source proxy for Open AI that allows you to track token usage and send it into a kafka stream (by PropsAI)
-
-
riskkernel
Deterministic cost / loop / time budgets · full observability · crash-resumable runs · human-approval gates · a memory you own. Self-hosted. Your keys. No telemetry. Point it at your existing agents - one env var.
Project mention: Benchmarking a kill switch for runaway AI agents -- and why the real number is a ceiling, not a % | dev.to | 2026-06-08The runtime is RiskKernel: open-source (Apache-2.0), self-hosted, pip install riskkernel or docker run, one env var in front of an agent you already have. Run the benchmark, then tell me where you'd push on it -- a benchmark only earns trust if people try to break it.
-
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
Go llms discussion
Go llms related posts
-
Sovereign Synapse: The Local Brain
-
How I Built a Self-Funding AI Lab: From Hobby to Side Income in 6 Months
-
Local LLM Hardware Requirements in 2026: What You Actually Need for Every Model Tier [Guide]
-
Run Coding Agents on Local AI — Zero Cloud, Full Control
-
Running Brand-New Gemma 4 12B on an 8-Year-Old GTX 1080 Ti: Speed, 3 Gotchas, and Why Q8 Beat Q4 on My Own Field
-
Agent Skills in Microsoft Agent Framework
-
Quick and easy local AI RAG setup with JetBrains IDE integration and browser UI
-
A note from our sponsor - SaaSHub
www.saashub.com | 9 Jun 2026
Index
What are some of the best open-source llm projects in Go? This list will help you:
| # | Project | Stars |
|---|---|---|
| 1 | ollama | 173,220 |
| 2 | aiac | 3,793 |
| 3 | chromem-go | 965 |
| 4 | voice-ai | 655 |
| 5 | hof | 608 |
| 6 | aqueduct | 519 |
| 7 | orla | 247 |
| 8 | gateway | 160 |
| 9 | dive | 126 |
| 10 | herd | 31 |
| 11 | mitto | 29 |
| 12 | raijin-mono | 26 |
| 13 | brag | 20 |
| 14 | llmscript | 14 |
| 15 | mmi | 14 |
| 16 | cmdfy | 12 |
| 17 | proxy | 11 |
| 18 | beago | 10 |
| 19 | riskkernel | 9 |
| 20 | sink | 7 |
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com