Go llama

Open-source Go projects categorized as llama
LLM Golang openai AI Go

Top 16 Go llama Projects

  1. ollama

    Get up and running with Kimi-K2.6, GLM-5.1, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

    Project mention: Set Up Your Own ChatGPT: Ollama + Open WebUI for Data That Never | dev.to | 2026-06-10

    Download: Go to https://ollama.com/ and click on the download link for your operating system.

  2. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  3. LocalAI

    LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

    Project mention: 5 Best Local LLM Tools and Models You Should Run in 2026 | dev.to | 2026-06-02

    LocalAI: https://github.com/mudler/LocalAI

  4. k8sgpt

    Giving Kubernetes Superpowers to everyone

    Project mention: What is an AI SRE? Definition, Capabilities, and 2026 Buyer's Lens | dev.to | 2026-05-21

    Infrastructure tool execution. The agent reads from kubectl, cloud SDKs, observability backends, and ticket systems. Some agents also write, with guardrails. HolmesGPT documents read-only access with RBAC respect. Aurora documents sandboxed execution into an isolated namespace. K8sGPT documents Kubernetes-only diagnostics with anonymisation before any AI backend call.

  5. openagent

    ⚡️next-generation personal AI assistant powered by LLM, RAG and agent loops, supporting computer-use, browser-use and coding agent, demo: https://demo.openagentai.org

    Project mention: I Built a Single-File AI Agent in Go — Zero Dependencies, Double-Click to Run | dev.to | 2026-05-18

    GitHub: github.com/the-open-agent/openagent ⭐

  6. llama-swap

    Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc

    Project mention: Llama-swap: Reliable model swapping | news.ycombinator.com | 2026-03-12
  7. tgpt

    AI Chatbots in terminal for free

  8. beelzebub

    A secure low code deception runtime framework, leveraging AI for System Virtualization.

    Project mention: Show HN: Beelzebub (OSS) – MCP "canary tools" for AI agents | news.ycombinator.com | 2025-09-07

    We’re open-sourcing a simple way to add “canary tools” to AI agents via MCP honeypots. These are functions your agent should never call during normal operation. If a canary is invoked, you get a high-fidelity signal of prompt-injection, tool hijacking, or lateralization—no heuristics, no extra model calls.

    What it is:

    - Go framework exposing decoy tools over MCP that look legitimate (names/params/descriptions), return safe dummy output, and emit telemetry when invoked.

    - Runs alongside your real tools; ship events to stdout/webhook or your pipeline (Prometheus/Grafana, ELK).

    Why it helps:

    Agent logs show what happened; canaries mark what must not happen. A single tripwire is an immediate, low-noise indicator of compromise.

    Real-world relevance (Nx attack):

    Recent reporting on the Nx npm supply-chain incident (“s1ngularity”) shows malicious versions exfiltrated SSH keys, tokens, and other secrets—and notably abused AI developer tools like Claude/Gemini in the workflow, one of the first documented cases of AI assistants being weaponized in a software supply-chain attack. If your IDE agent (Claude Code or Gemini Code/CLI) had a canary tool registered—e.g., a fake “export secrets” or “repo exfil” action—any unauthorized tool call from the agent side would have triggered a deterministic alert during that incident.

    Links:

    GitHub: https://github.com/mariocandela/beelzebub

  9. llama.go

    llama.go is like llama.cpp in pure Golang!

  10. chatgpt-cli

    ChatGPT CLI is a powerful, multi-provider command-line interface for working with modern LLMs. It supports OpenAI, Azure, Perplexity, LLaMA, and more, with features like streaming, interactive chat, prompt files, image/audio I/O, MCP tool calls, and an experimental agent mode for safe, multi-step automation.

    Project mention: Just shipped an agent mode (ReAct) in my CLI for LLMs | news.ycombinator.com | 2026-01-17
  11. aikit

    🏗️ Fine-tune, build, and deploy open-source LLMs easily!

  12. ingest

    Parse files (e.g. code repos) and websites to clipboard or a file for ingestions by AI / LLMs

  13. llama-nuts-and-bolts

    A holistic way of understanding how Llama and its components run in practice, with code and detailed documentation.

  14. maestro

    Turn natual language into commands. Your CLI tasks, now as easy as a conversation. Run it 100% offline, or use OpenAI's models. (by pluja)

  15. taubyte-llama-satellite

  16. ApiCloudLLaMA

    The idea is to make an api that everyone can consume in their GPT4-like applications but with free models, to democratize its use.

  17. prepare-commit-msg-ai

    Prepare Git Commit Message with AI: Write commit message based on code changes with AI.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Go llama discussion

Log in or Post with

Go llama related posts

  • Set Up Your Own ChatGPT: Ollama + Open WebUI for Data That Never

    1 project | dev.to | 10 Jun 2026
  • I Built a Free, Fully Local AI Resume Builder — No Subscriptions, No Cloud, No Catch

    1 project | dev.to | 10 Jun 2026
  • Sovereign Synapse: The Local Brain

    1 project | dev.to | 9 Jun 2026
  • How I Built a Self-Funding AI Lab: From Hobby to Side Income in 6 Months

    1 project | dev.to | 9 Jun 2026
  • Local LLM Hardware Requirements in 2026: What You Actually Need for Every Model Tier [Guide]

    1 project | dev.to | 8 Jun 2026
  • Run Coding Agents on Local AI — Zero Cloud, Full Control

    1 project | dev.to | 6 Jun 2026
  • Running Brand-New Gemma 4 12B on an 8-Year-Old GTX 1080 Ti: Speed, 3 Gotchas, and Why Q8 Beat Q4 on My Own Field

    1 project | dev.to | 4 Jun 2026
  • A note from our sponsor - SaaSHub
    www.saashub.com | 12 Jun 2026
    SaaSHub helps you find the best software and product alternatives Learn more →

Index

What are some of the best open-source llama projects in Go? This list will help you:

# Project Stars
1 ollama 173,924
2 LocalAI 46,698
3 k8sgpt 7,859
4 openagent 5,230
5 llama-swap 4,477
6 tgpt 3,180
7 beelzebub 2,045
8 llama.go 1,397
9 chatgpt-cli 930
10 aikit 526
11 ingest 374
12 llama-nuts-and-bolts 316
13 maestro 63
14 taubyte-llama-satellite 17
15 ApiCloudLLaMA 13
16 prepare-commit-msg-ai 3

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com

Did you know that Go is
the 4th most popular programming language
based on number of references?