Top 3 Zig Inference Projects
-
Project mention: Zig's New BitCast Semantics and LLVM Back End Improvements | news.ycombinator.com | 2026-06-25
-
AppSignal
AppSignal knows why the f*#k it crashed. Stop vibe-debugging. Every exception, every backtrace, grouped so you see patterns, not noise.
-
mlx-serve
Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Includes MLX Core macOS app with chat, agent mode, and tool calling.
-
talu
Talu is a single-binary, local-first LLM runtime with a Zig core and multi-language bindings — CLI, Python API, HTTP server, plugin-extensible Web UI, structured output, quantization, embeddings, and unified local/remote model routing.
Project mention: Show HN: Talu, single-binary, local-first LLM runtime | news.ycombinator.com | 2026-02-12
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
Zig Inference discussion
Index
What are some of the best open-source Inference projects in Zig? This list will help you:
| # | Project | Stars |
|---|---|---|
| 1 | zml | 4,018 |
| 2 | mlx-serve | 1,127 |
| 3 | talu | 11 |
Sponsored
AppSignal knows why the f*#k it crashed.
Stop vibe-debugging. Every exception, every backtrace, grouped so you see patterns, not noise.
www.appsignal.com