APM, error tracking, and dashboards for modern web apps. Ten-minute setup, transparent flat pricing, and support from engineers who actually use the product. Learn more →
Top 8 Go edge-ai Projects
-
Under the hood, when you want to run more than one lhttp server (because one server is never enough once your chat app takes off, right?), all the servers talk to each other through NATS, specifically an ancient bundled copy of gnatsd.
-
AppSignal
Monitoring that respects your time & budget. APM, error tracking, and dashboards for modern web apps. Ten-minute setup, transparent flat pricing, and support from engineers who actually use the product.
-
The 'spent 100 hours configuring' part hits home. That fragmentation is exactly why we started building Olares (https://github.com/beclab/Olares).
It’s basically an open-source OS layer that standardizes the local AI stack—Kubernetes (K3s) for orchestration, standardized model serving, and GPU scheduling. The goal is to stop fiddling with Python environments/drivers and just treat local agents like standardized containers. It runs on Mac Minis or dedicated hardware.
-
defradb
DefraDB is a Peer-to-Peer Edge-First Database. It's the core data storage system for the Source Ecosystem.
Project mention: DefraDB v1.0 RC1: A Peer-to-Peer Database for Edge AI and Offline-First Apps | dev.to | 2026-03-18git clone https://github.com/sourcenetwork/defradb.git cd defradb make install defradb start
-
spinifex
Open-source, AWS-compatible cloud for bare-metal, edge and on-premise. Run existing AWS CLI, SDK and Terraform workflows against EC2, EBS, S3, VPC, IAM, EKS and RDS on your own servers.
Project mention: We moved a real homelab onto Spinifex and deleted six operators | dev.to | 2026-10-12So from here, I set out to move the homelab onto Spinifex, our AWS-compatible cloud for bare metal.
-
LLMKube
Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.
Project mention: A weekend with TensorFold on a MacBook: the engine mattered, the quant did not | dev.to | 2026-09-28Then I reviewed all nine by hand, because a green gate is not a review. Two of the nine had real defects the gate could not see. One draft hardcoded a test port, so its tests failed whenever something else on the machine was using it. Another sized a relative file path against the agent's working directory. Each quant ended up writing the version I picked for one issue, and those three are open as pull requests #1928, #1929 and #1930. Three issues is a small sample, and I would not claim the quants are equal on harder work. What I can say is that on real issues in this repo, the choice of quant did not change the outcome, and the choice of engine changed the wait by about 3x.
-
voxrt-wake-word-linux
On-device wake-phrase detection for Linux aarch64 — one glibc-2.17 .so behind Python (PyPI wheel), Node.js (npm), Go (go get), C/C++ (tarball + CMake), Rust. RTF 0.053 on Raspberry Pi Zero 2 W. Same runtime as voxrt-wake-word-{android,ios}.
Linux (Pi, Jetson, servers): voxrt-wake-word-linux, voxrt-kws-linux, voxrt-asr-linux
-
voxrt-kws-linux
On-device 14-way keyword spotter for Linux x86_64 + aarch64 — one glibc-2.17 .so behind Python (PyPI), Node.js (npm), Go (go get), C / C++ (tarball + CMake). Streaming Conformer, RTF 1 % on WSL AVX2, 32 % on Pi Zero 2 W NEON. Same runtime as voxrt-kws-{android,ios} (upcoming).
Linux (Pi, Jetson, servers): voxrt-wake-word-linux, voxrt-kws-linux, voxrt-asr-linux
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
Project mention: Show HN: Nibia Fabric – Turn everyday computers into a shared AI compute cluster | news.ycombinator.com | 2026-09-28
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
Go edge-ai discussion
Go edge-ai related posts
-
A weekend with TensorFold on a MacBook: the engine mattered, the quant did not
-
Every release makes the harness harder to fool: LLMKube 0.9.19
-
One GPU, four ways to share it: ten scenarios, and the one number that inverts on your hardware
-
LLMKube – A Kubernetes operator for local LLMs across Nvidia and Mac fleets
-
LLMKube Now Deploys Any Inference Engine, Not Just llama.cpp
-
I tested speculative decoding on my home GPU cluster. Here's why it didn't help.
-
The $0 Problem: Why Every Tool Says Your On-Prem Inference is Free
-
A note from our sponsor - AppSignal
www.appsignal.com | 13 Oct 2026
Index
What are some of the best open-source edge-ai projects in Go? This list will help you:
| # | Project | Stars |
|---|---|---|
| 1 | NATS | 20,852 |
| 2 | Olares | 5,311 |
| 3 | defradb | 894 |
| 4 | spinifex | 351 |
| 5 | LLMKube | 231 |
| 6 | voxrt-wake-word-linux | 13 |
| 7 | voxrt-kws-linux | 9 |
| 8 | fabric | 4 |
Sponsored
Monitoring that respects your time & budget
APM, error tracking, and dashboards for modern web apps. Ten-minute setup, transparent flat pricing, and support from engineers who actually use the product.
www.appsignal.com