Hosting Your Own AI Chatbot on Android Devices

• llama.cpp

  769 56,891 10.0 C++

  LLM inference in C/C++

git clone https://github.com/ggerganov/llama.cpp.git

• termux-ndk

  12 460 3.5 C

  android-ndk for termux

Next, we need to set up the Android NDK (Native Development Kit) to compile the llama.cpp project. Visit the Termux-NDK repository and download the latest NDK release. Extract the ZIP file, then set the NDK path in Termux:

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• CLBlast

  4 995 6.6 C++

  Tuned OpenCL BLAS

git clone https://github.com/CNugteren/CLBlast.git cd CLBlast cmake . cmake --build . --config Release mkdir install cmake --install . --prefix ~/CLBlast/install cp libclblast.so* $PREFIX/lib cp ./include/clblast.h ../llama.cpp

Suggest a related project