The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning. Learn more →
Top 9 C++ stable-diffusion Projects
-
LocalAI
:robot: The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. It allows to generate Text, Audio, Video, Images. Also with voice cloning capabilities.
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
FastDeploy
⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support.
-
OnnxStream
Lightweight inference library for ONNX files, written in C++. It can run SDXL on a RPI Zero 2 but also Mistral 7B on desktops and servers.
-
nitro
An inference server on top of llama.cpp. OpenAI-compatible API, queue, & scaling. Embed a prod-ready, local inference engine in your apps. Powers Jan (by janhq)
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
Project mention: I've open sourced my Flutter plugin to run on-device LLMs on any platform. TestFlight builds available now. | /r/FlutterDev | 2023-12-08I did start with integrating SD with this repo: https://github.com/leejet/stable-diffusion.cpp
Project mention: Show HN: OnnxStream running TinyLlama and Mistral 7B, with CUDA support | news.ycombinator.com | 2024-01-14
I'd like to see a comparison to nitro https://github.com/janhq/nitro which has been fantastic for running a local LLM.
Project mention: Stable Diffusion implemented by ncnn framework based on C++, supported txt2img and img2img! | /r/StableDiffusion | 2023-06-08
C++ stable-diffusion related posts
- Open-source project ZLUDA lets CUDA apps run on AMD GPUs
- Show HN: OnnxStream running TinyLlama and Mistral 7B, with CUDA support
- OnnxStream running TinyLlama and Mistral 7B, with CUDA support
- Running Stable Diffusion in 260MB of RAM
- Running Stable Diffusion in 260MB of RAM
- Running Stable Diffusion in 260MB of RAM
- Running Stable Diffusion in 260MB of RAM!
-
A note from our sponsor - WorkOS
workos.com | 29 Apr 2024
Index
What are some of the best open-source stable-diffusion projects in C++? This list will help you:
Project | Stars | |
---|---|---|
1 | LocalAI | 19,593 |
2 | openvino | 5,911 |
3 | FastDeploy | 2,705 |
4 | stable-diffusion.cpp | 2,555 |
5 | OnnxStream | 1,739 |
6 | nitro | 1,572 |
7 | Stable-Diffusion-NCNN | 935 |
8 | SDImageGenerator | 24 |
9 | diffusion-expert | 22 |
Sponsored