Running Wizard 7b (Q2) on an 8gb Android Phone

• llama.cpp

  792 59,810 10.0 C++

  LLM inference in C/C++

Termux -> build llama.cpp (be sure to make the change detailed on this Git issue otherwise you'll get illegal instruction errors) -> wget your favorite models and run with the main executable just as you normally would.

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• maid

  5 931 9.9 Dart

  Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely. (by Mobile-Artificial-Intelligence)

  

Try this: https://github.com/MaidFoundation/maid

Suggest a related project