Zig LLM

Open-source Zig projects categorized as LLM

Large Language Models

Edit details
Zig AI zig-package CLI llama
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured

Top 6 Zig LLM Projects

Zig logo
LLM

  1. zigformer

    An educational transformer-based LLM in pure Zig

    Project mention: Show HN: ZigFormer – An LLM implemented in pure Zig | news.ycombinator.com | 2025-11-27

    Hi everyone,

    I've made an early version of ZigFormer, a small LLM implemented in Zig with no dependencies on external ML frameworks like PyTorch or JAX. ZigFormer is modelled after a textbook LLM (like GPT-2 from OpenAI) and can be used as a Zig library as well as a standalone application to train a model and chat with it.

    This was mainly an educational project. I'm sharing it here in case others find it interesting or useful.

    Link to the project: https://github.com/CogitatorTech/zigformer

  2. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo

  3. MLX.zig

    MLX.zig: Phi-4, Llama 3.2, and Whisper in Zig

  4. retro-agent

    A lightweight AI agent for legacy hardware. Written in Zig, runs on Windows XP SP3 x86 with 64 MB RAM. Connects to Ollama for LLM-powered system diagnostics and management via function calling.

    Project mention: I built an AI agent in Zig that runs on Windows XP with 64 MB RAM | news.ycombinator.com | 2026-03-11

    legacy Windows systems or working with Zig's cross-compilation story.

    https://github.com/benmaster82/retro-agent

  5. playpanda

    Fetch any URL to clean, LLM-ready markdown. 3-tier engine: HTTP → Lightpanda → CloakBrowser.

    Project mention: Your AI agent can't fetch behind logins. I built a <400kb fix in Zig. | dev.to | 2026-03-28

    git clone https://github.com/ancs21/playpanda.git cd playpanda zig build -Doptimize=.ReleaseFast cp zig-out/bin/playpanda ~/.local/bin/

  6. talu

    Talu is a single-binary, local-first LLM runtime with a Zig core and multi-language bindings — CLI, Python API, HTTP server, plugin-extensible Web UI, structured output, quantization, embeddings, and unified local/remote model routing.

    Project mention: Show HN: Talu, single-binary, local-first LLM runtime | news.ycombinator.com | 2026-02-12

  7. hf-hub-zig

    Zig library and CLI for interacting with the HuggingFace Hub API, with a focus on GGUF model discovery, searching, viewing, and downloading.

    Project mention: Building AI Infrastructure for a Post-Framework World | dev.to | 2026-01-13

    Repository: hf-hub-zig

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Zig LLM discussion

Log in or Post with

Zig LLM related posts

  • I built an AI agent in Zig that runs on Windows XP with 64 MB RAM

    1 project | news.ycombinator.com | 11 Mar 2026

  • Show HN: Only 1 LLM can fly a drone

    3 projects | news.ycombinator.com | 26 Jan 2026

  • How to create an AI agent powered by your screen & mic

    3 projects | dev.to | 21 Jan 2025

Index

What are some of the best open-source LLM projects in Zig? This list will help you:

# Project Stars
1 zigformer 51
2 MLX.zig 33
3 retro-agent 11
4 playpanda 10
5 talu 9
6 hf-hub-zig 2

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com

Did you know that Zig is
the 17th most popular programming language
based on number of references?

Loading...