I've open sourced my Flutter plugin to run on-device LLMs on any platform. TestFlight builds available now.

• stable-diffusion.cpp

  10 2,555 8.8 C++

  Stable Diffusion in pure C/C++

And more stuff I’m often checking back on: - https://github.com/staghado/vit.cpp - https://github.com/serp-ai/bark-with-voice-clone - https://github.com/leejet/stable-diffusion.cpp (generate images) - etc … there’s too much fun stuff out there. Wish I had more free time haha.

• aub.ai

  5 139 7.7 Dart

  AubAI brings you on-device gen-AI capabilities, including offline text generation and more, directly within your app.

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• whisper.cpp

  187 31,174 9.8 C

  Port of OpenAI's Whisper model in C/C++

Usage 1: Good to transcribe audio. An example use case could be to summarize YouTube videos or long courses. Usage 2: You talk with voice to your AI that responds with text (later with audio too). - https://github.com/ggerganov/whisper.cpp

• StyleTTS2

  7 4,036 8.7 Python

  StyleTTS 2: Towards Human-Level Text-to-Speech through Style Diffusion and Adversarial Training with Large Speech Language Models

• bark.cpp

  4 513 8.1 C++

  Port of Suno AI's Bark in C/C++ for fast inference

• vit.cpp

  2 172 8.8 C++

  Inference Vision Transformer (ViT) in plain C/C++ with ggml

And more stuff I’m often checking back on: - https://github.com/staghado/vit.cpp - https://github.com/serp-ai/bark-with-voice-clone - https://github.com/leejet/stable-diffusion.cpp (generate images) - etc … there’s too much fun stuff out there. Wish I had more free time haha.

• bark-with-voice-clone

  19 2,818 7.5 Python

  🔊 Text-prompted Generative Audio Model - With the ability to clone voices

  

And more stuff I’m often checking back on: - https://github.com/staghado/vit.cpp - https://github.com/serp-ai/bark-with-voice-clone - https://github.com/leejet/stable-diffusion.cpp (generate images) - etc … there’s too much fun stuff out there. Wish I had more free time haha.

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• web_ffi

  1 19 0.0 JavaScript

  Translates dart:ffi calls on the web to WebAssembly using dart:js

  

I leverage ffi and ffigen, but they don’t support web yet. I rely on them at the moment. But a quick search tells me there’s a decent chance to get this to work, there’s this package for example https://github.com/EP-u-NW/web_ffi (not maintained, but good nonetheless for inspiration).

Suggest a related project