Dart llamacpp Projects
-
maid
Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely. (by Mobile-Artificial-Intelligence)
-
aub.ai
AubAI brings you on-device gen-AI capabilities, including offline text generation and more, directly within your app.
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
Project mention: Phi-3 Technical a Highly Capable Language Model Locally on Your Phone | news.ycombinator.com | 2024-04-23I've been trying this app but haven't had any luck getting it to actually generate text yet:
https://github.com/Mobile-Artificial-Intelligence/maid
The UI looks nice and includes a native compilation of llama.cpp.
My main phone's screen broke so I'm on an old Pixel 4 until it's repaired but I've had no luck getting 2-3GB models to run so far.
https://github.com/BrutalCoding/aub.ai
For any of your Apple devices, use this:
Index
Sponsored