SaaSHub helps you find the best software and product alternatives Learn more →
Top 23 C++ AI Projects
-
Website: clickhouse.com
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
AirSim
Open source simulator for autonomous vehicles built on Unreal Engine / Unity, from Microsoft AI & Research
-
-
Project mention: OpenVINO – open-source toolkit for optimizing and deploying AI inference | news.ycombinator.com | 2025-12-28
-
deeplake
Deeplake is AI Data Runtime for Agents. It provides serverless postgres with a multimodal datalake, enabling scalable retrieval and training.
-
-
-
-
Project mention: Show HN: Gosd: High-performance Stable Diffusion inference in pure Go(no CGO) | news.ycombinator.com | 2026-05-07
https://github.com/leejet/stable-diffusion.cpp for the full list of compatible models.
On my local setup with Radeon 7900XTX, a full HD image can be generated in about 10-30sec.
-
Project mention: Show HN: Needle: We Distilled Gemini Tool Calling into a 26M Model | news.ycombinator.com | 2026-05-12
- Dataset synthesized via Gemini with 15 tool categories (timers, messaging, navigation, smart home, etc.)
You can test it right now and finetune on your Mac/PC: https://github.com/cactus-compute/needle
The full writeup on the architecture is here: https://github.com/cactus-compute/needle/blob/main/docs/simp...
We found that the "no FFN" finding generalizes beyond function calling to any task where the model has access to external structured knowledge (RAG, tool use, retrieval-augmented generation). The model doesn't need to memorize facts in FFN weights if the facts are provided in the input. Experimental results to published.
While it beats FunctionGemma-270M, Qwen-0.6B, Granite-350M, LFM2.5-350M on single-shot function calling, those models have more scope/capacity and excel in conversational settings. We encourage you to test on your own tools via the playground and finetune accordingly.
This is part of our broader work on Cactus (https://github.com/cactus-compute/cactus), an inference engine built from scratch for mobile, wearables and custom hardware. We wrote about Cactus here previously: https://news.ycombinator.com/item?id=44524544
Everything is MIT licensed. Weights: https://huggingface.co/Cactus-Compute/needle
-
OpenCat-Quadruped-Robot
An open source quadruped robot pet framework for developing Boston Dynamics-style four-legged robots that are perfect for STEM, coding & robotics education, IoT robotics applications, AI-enhanced robotics application services, research, and DIY robotics kit development.
-
-
lemonade
Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
Project mention: Adding Gemma 4 speech recognition to a .NET desktop app: the llama-server sidecar that survived | dev.to | 2026-05-26Lemonade is strong on Ryzen AI hardware, but it is AMD-specific. Cross-vendor was a hard requirement.
-
-
rocketride-server
High-performance AI pipeline engine with a C++ core and 50+ Python-extensible nodes. Build, debug, and scale LLM workflows with 13+ model providers, 8+ vector databases, and agent orchestration, all from your IDE. Includes VS Code extension, TypeScript/Python SDKs, and Docker deployment.
Project mention: Building a multi-step AI pipeline workspace + 2 OSS fixes to RocketRide server | dev.to | 2026-05-05PR #754 (test mocks): fixes Python truthiness traps (bool treated as int, limit=0, 0.0 sorting) https://github.com/rocketride-org/rocketride-server/pull/754
-
-
Project mention: OpenCV 5 Is Here: The Biggest Leap in Years for Computer Vision | news.ycombinator.com | 2026-06-10
Thank you for the recommendations, I'll return one myself:
https://github.com/alicevision/AliceVision
-
-
-
Project mention: Show HN: Moonshine Open-Weights STT models – higher accuracy than WhisperLargev3 | news.ycombinator.com | 2026-02-24
I've helped many Twitch streamers set up https://github.com/royshil/obs-localvocal to plug transcription & translation into their streams, mainly for German audio to English subtitles. I'd love a faster and more accurate option than Whisper, but streamers need something off-the-shelf they can install in their pipeline, like an OBS plugin which can just grab the audio from their OBS audio sources. Also this doesn't seem to support translation which is unfortunate, that's pretty key for this usecase.
-
There are a few more bounties like this out there.
1. Tenstorrent https://github.com/tenstorrent/tt-metal/issues?q=is%3Aissue%... $200 - $3,000 bounties
2. microG https://github.com/microg/GmsCore/issues/2994 $10,000 bounty
3. Li Haoyi https://github.com/orgs/com-lihaoyi/discussions/6 multiple bounties (already mentioned upthread)
4. Algora also hosts bounties for COSS (Commercial OSS) https://algora.io/bounties
-
-
uccl
UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g., GPU-driven)
Project mention: UCCL: An Extensible Software Transport Layer for GPU Networking | news.ycombinator.com | 2025-06-28
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
C++ AI discussion
C++ AI related posts
-
Show HN: Gosd: High-performance Stable Diffusion inference in pure Go(no CGO)
-
Building a multi-step AI pipeline workspace + 2 OSS fixes to RocketRide server
-
Vector Search Benchmark: FAISS 1.9 vs. Chroma 0.6 vs. Pinecone 1.6 for 100M Embedding Datasets
-
Google Released Gemma 4 Yesterday. I Had It Fixing Real Bugs by Lunch.
-
I Tested TurboQuant KV Cache Compression on Consumer GPUs. Here's What Actually Happened.
-
Your IDE Is Now the AI Command Center
-
Universal Memory Layer Architecture for AI Agents
-
A note from our sponsor - SaaSHub
www.saashub.com | 11 Jun 2026
Index
What are some of the best open-source AI projects in C++? This list will help you:
| # | Project | Stars |
|---|---|---|
| 1 | ClickHouse | 47,849 |
| 2 | AirSim | 18,223 |
| 3 | carlo | 14,032 |
| 4 | openvino | 10,335 |
| 5 | deeplake | 9,168 |
| 6 | Recast/Detour | 7,754 |
| 7 | interpret | 6,876 |
| 8 | Firebase | 6,617 |
| 9 | stable-diffusion.cpp | 6,168 |
| 10 | cactus | 5,332 |
| 11 | OpenCat-Quadruped-Robot | 4,861 |
| 12 | webots | 4,396 |
| 13 | lemonade | 4,212 |
| 14 | BehaviorTree.CPP | 4,049 |
| 15 | rocketride-server | 3,743 |
| 16 | habitat-sim | 3,699 |
| 17 | AliceVision | 3,431 |
| 18 | DataFrame | 2,958 |
| 19 | bwapi | 1,661 |
| 20 | obs-localvocal | 1,506 |
| 21 | tt-metal | 1,493 |
| 22 | aitrack | 1,430 |
| 23 | uccl | 1,409 |
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com