termux-ndk
CLBlast
| termux-ndk | CLBlast | |
|---|---|---|
| 12 | 4 | |
| 465 | 995 | |
| - | - | |
| 3.5 | 6.6 | |
| 4 months ago | about 1 month ago | |
| C | C++ | |
| GNU General Public License v3.0 or later | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
termux-ndk
-
Hosting Your Own AI Chatbot on Android Devices
Next, we need to set up the Android NDK (Native Development Kit) to compile the llama.cpp project. Visit the Termux-NDK repository and download the latest NDK release. Extract the ZIP file, then set the NDK path in Termux:
-
How install Koboldcpp via Termux (Guide)
10 - Install the Android SDK by copying and pasting the following command in the console: wget https://github.com/lzhiyong/termux-ndk/releases/download/ndk-r23/android-ndk-r23c-aarch64.zip unzip android-ndk-r23c-aarch64.zip export NDK=~/android-ndk-r23c-aarch64
-
Pain
You can use termux. r/termux. For ndk you can use https://github.com/Lzhiyong/termux-ndk for cmake below 3.14 (I think) you have to use a prooted distro. For build-tools you cant use sdkmanager unless you use android studio in GUI mode . you have to download manually . there is a website for that . and that's how you build android apps in Android.
- I need a help 🙏
- basic xfce session
-
Android Studio ARM build
And for ndk I guess you can use this if there is no arm official build. https://github.com/Lzhiyong/termux-ndk
-
Documentation of building Android apps in termux.
And the docs : https://github.com/Lzhiyong/termux-ndk/tree/master/build-app
-
Static binaries clang termux .
Found this https://github.com/Lzhiyong/termux-ndk/blob/master/patches/align_fix.py to patch the binary. But why do I need to patch it?
-
Terminal emulator for X
Did you install ndk from here? https://github.com/Lzhiyong/termux-ndk
-
Flutter with code-server, looking for aarch64 based Android SDK.
You can check out this repo
CLBlast
-
Hosting Your Own AI Chatbot on Android Devices
git clone https://github.com/CNugteren/CLBlast.git cd CLBlast cmake . cmake --build . --config Release mkdir install cmake --install . --prefix ~/CLBlast/install cp libclblast.so* $PREFIX/lib cp ./include/clblast.h ../llama.cpp
-
Can't compile llama-cpp-python with CLBLAST
I'm trying to get GPU-Acceleration to work with oobabooga's webui, there it says that I just have to reinstall the llama-cpp-python in the environment and have it compile with CLBLAST.So I have CLBLAST downloaded and unzipped, but when I try to do it with:
-
How to OpenCL on a raspberry Pi
Which raspberry Pi? For Pi 1 - 3, you can use VC4CL . While it's an impressive effort, it is highly experimental and does not always work as it should. I spent some non-trivial time trying to get CLBlast (a BLAS implementation for OpenCL) working on a 3b+, but there's always something hanging or not giving the right results.
-
OpenCL in Termux
Install CLBlast: cd git clone https://github.com/CNugteren/CLBlast.git cd CLBlast cmake -B build \ -DBUILD_SHARED_LIBS=OFF \ -DTUNERS=OFF \ -DCMAKE_BUILD_TYPE=Release \ -DCMAKE_INSTALL_PREFIX=/data/data/com.termux/files/usr cd build make -j8 make install
What are some alternatives?
android-iperf - Pre-compiled iperf/iperf3 binaries for Android + Dockerfile with SDK and NDK for manual build
monolish - monolish: MONOlithic LInear equation Solvers for Highly-parallel architecture
llvm-project - The LLVM Project is a collection of modular and reusable compiler and toolchain technologies. Note: the repository does not accept github pull requests at this moment. Please submit your patches at http://reviews.llvm.org.
llama.cpp - LLM inference in C/C++
cling - The cling C++ interpreter
limited-systems - Limited Systems
play-audio - Command-line tool to play audio using OpenSL ES.
VC4CL - OpenCL implementation running on the VideoCore IV GPU of the Raspberry Pi models
zapcc - zapcc is a caching C++ compiler based on clang, designed to perform faster compilations
ArrayFire - ArrayFire: a general purpose GPU library.
Termux-Java - Install Java (Open-JDK-8) in Termux without root!
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.