Top 11 Zig LLM Projects

LLM

• Add a project

1. mlx-serve

   1 3 1,826 9.7 Zig

   Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation.

   

   Project mention: vllm-mlx on Apple Silicon: Continuous Batching Works, but Unified Memory Sets the Real Limit | dev.to | 2026-10-09

   Instead, we reviewed the installation instructions and CLI options, then assessed throughput and configuration trade-offs using the Apple Silicon benchmark cases for vllm-mlx continuous batching, mlx-serve performance, and mlxcel scheduling. We did not execute an installation or CLI contract test in the sandbox. We used the throughput values below as benchmark reference points, not as measurements from this Linux host or a validated production capacity envelope.

2. AppSignal

   www.appsignal.com sponsored

   Monitoring that respects your time & budget. APM, error tracking, and dashboards for modern web apps. Ten-minute setup, transparent flat pricing, and support from engineers who actually use the product.

   

3. llama2.zig

   2 1 223 4.8 Zig

   Inference Llama 2 in one file of pure Zig (by cgbur)

   

   Project mention: llama2.zig: Inference Llama 2 in one file of pure Zig | news.ycombinator.com | 2025-12-06

4. zigformer

   3 1 52 4.1 Zig

   An educational transformer-based LLM in pure Zig

   

   Project mention: Show HN: ZigFormer – An LLM implemented in pure Zig | news.ycombinator.com | 2025-11-27

   Hi everyone,

   I've made an early version of ZigFormer, a small LLM implemented in Zig with no dependencies on external ML frameworks like PyTorch or JAX. ZigFormer is modelled after a textbook LLM (like GPT-2 from OpenAI) and can be used as a Zig library as well as a standalone application to train a model and chat with it.

   This was mainly an educational project. I'm sharing it here in case others find it interesting or useful.

   Link to the project: https://github.com/CogitatorTech/zigformer

5. MLX.zig

   4 1 35 7.3 Zig

   MLX.zig: Phi-4, Llama 3.2, and Whisper in Zig

   

6. csvql

   5 2 30 9.6 Zig

   SQL queries for CSV files. The analytical CSV query engine for AI agents cli: csvql.

   

   Project mention: For Structured Data, Retrieval Accuracy Isn't a Model Problem | dev.to | 2026-08-13

   This is why csvql's benchmarking has always focused on two things: does the query return the exact same result set DuckDB does, and how many tokens does an agent spend getting that result.

7. zsort

   6 2 25 8.7 Zig

   Opinionated import organizer for Zig similar to isort / goimports

   

   Project mention: Show HN: Zsort, a fast import organizer for Zig | news.ycombinator.com | 2026-08-11

8. retro-agent

   7 2 21 5.2 Zig

   A lightweight AI agent for legacy hardware. Written in Zig, runs on Windows XP SP3 x86 with 64 MB RAM. Connects to Ollama for LLM-powered system diagnostics and management via function calling.

   

   Project mention: I built an AI agent in Zig that runs on Windows XP with 64 MB RAM | news.ycombinator.com | 2026-03-11

   legacy Windows systems or working with Zig's cross-compilation story.

   https://github.com/benmaster82/retro-agent

9. SaaSHub

   www.saashub.com sponsored

   SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

   

10. playpanda

    8 1 11 6.5 Zig

    Fetch any URL to clean, LLM-ready markdown. 3-tier engine: HTTP → Lightpanda → CloakBrowser.

    

    Project mention: Your AI agent can't fetch behind logins. I built a <400kb fix in Zig. | dev.to | 2026-03-28

    git clone https://github.com/ancs21/playpanda.git cd playpanda zig build -Doptimize=.ReleaseFast cp zig-out/bin/playpanda ~/.local/bin/

11. talu

    9 1 11 9.7 Zig

    Talu is a single-binary, local-first LLM runtime with a Zig core and multi-language bindings — CLI, Python API, HTTP server, plugin-extensible Web UI, structured output, quantization, embeddings, and unified local/remote model routing.

    

    Project mention: Show HN: Talu, single-binary, local-first LLM runtime | news.ycombinator.com | 2026-02-12

12. hf-hub-zig

    10 1 2 5.4 Zig

    Zig library and CLI for interacting with the HuggingFace Hub API, with a focus on GGUF model discovery, searching, viewing, and downloading.

    

    Project mention: Building AI Infrastructure for a Post-Framework World | dev.to | 2026-01-13

    Repository: hf-hub-zig

13. emetgate

    11 1 0 9.2 Zig

    A deterministic verification kernel between LLM agents and your source tree. The model proposes, the kernel verifies.

    

    Project mention: Show HN: Emetgate – a verification gate between an LLM and your source tree | news.ycombinator.com | 2026-09-20

Zig LLM related posts

• I built an AI agent in Zig that runs on Windows XP with 64 MB RAM

  1 project | news.ycombinator.com | 11 Mar 2026

• Show HN: Only 1 LLM can fly a drone

  3 projects | news.ycombinator.com | 26 Jan 2026

• How to create an AI agent powered by your screen & mic

  3 projects | dev.to | 21 Jan 2025

Index

Sponsored

Monitoring that respects your time & budget

APM, error tracking, and dashboards for modern web apps. Ten-minute setup, transparent flat pricing, and support from engineers who actually use the product.

www.appsignal.com

Do not miss the trending Zig projects with our weekly report!