vit.cpp
web_ffi
| vit.cpp | web_ffi | |
|---|---|---|
| 2 | 1 | |
| 177 | 19 | |
| - | - | |
| 8.8 | 0.0 | |
| 29 days ago | 6 months ago | |
| C++ | JavaScript | |
| MIT License | BSD 2-clause "Simplified" License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
vit.cpp
-
I've open sourced my Flutter plugin to run on-device LLMs on any platform. TestFlight builds available now.
And more stuff I’m often checking back on: - https://github.com/staghado/vit.cpp - https://github.com/serp-ai/bark-with-voice-clone - https://github.com/leejet/stable-diffusion.cpp (generate images) - etc … there’s too much fun stuff out there. Wish I had more free time haha.
-
[P] Inference Vision Transformer (ViT) in plain C/C++ with ggml
You can access it here: https://github.com/staghado/vit.cpp It has been added to the ggml library on GitHub: https://github.com/ggerganov/ggml
web_ffi
-
I've open sourced my Flutter plugin to run on-device LLMs on any platform. TestFlight builds available now.
I leverage ffi and ffigen, but they don’t support web yet. I rely on them at the moment. But a quick search tells me there’s a decent chance to get this to work, there’s this package for example https://github.com/EP-u-NW/web_ffi (not maintained, but good nonetheless for inspiration).
What are some alternatives?
stable-diffusion.cpp - Stable Diffusion in pure C/C++
minigpt4.cpp - Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)
aub.ai - AubAI brings you on-device gen-AI capabilities, including offline text generation and more, directly within your app.
EdgeML - This repository provides code for machine learning algorithms for edge devices developed at Microsoft Research India.
Daisykit - Daisykit is an easy AI toolkit with face mask detection, pose detection, background matting, barcode detection, and more. With Daisykit, you don't need AI knowledge to build AI software.
tokay-lite-sdk - Tokay Lite: Low Power Edge AI Camera SDK
bark.cpp - Port of Suno AI's Bark in C/C++ for fast inference
frugally-deep - A lightweight header-only library for using Keras (TensorFlow) models in C++.
ggml - Tensor library for machine learning