CLBlast
VC4CL
| CLBlast | VC4CL | |
|---|---|---|
| 4 | 6 | |
| 997 | 721 | |
| - | - | |
| 6.6 | 0.0 | |
| about 1 month ago | over 1 year ago | |
| C++ | C++ | |
| Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
CLBlast
-
Hosting Your Own AI Chatbot on Android Devices
git clone https://github.com/CNugteren/CLBlast.git cd CLBlast cmake . cmake --build . --config Release mkdir install cmake --install . --prefix ~/CLBlast/install cp libclblast.so* $PREFIX/lib cp ./include/clblast.h ../llama.cpp
-
Can't compile llama-cpp-python with CLBLAST
I'm trying to get GPU-Acceleration to work with oobabooga's webui, there it says that I just have to reinstall the llama-cpp-python in the environment and have it compile with CLBLAST.So I have CLBLAST downloaded and unzipped, but when I try to do it with:
-
How to OpenCL on a raspberry Pi
Which raspberry Pi? For Pi 1 - 3, you can use VC4CL . While it's an impressive effort, it is highly experimental and does not always work as it should. I spent some non-trivial time trying to get CLBlast (a BLAS implementation for OpenCL) working on a 3b+, but there's always something hanging or not giving the right results.
-
OpenCL in Termux
Install CLBlast: cd git clone https://github.com/CNugteren/CLBlast.git cd CLBlast cmake -B build \ -DBUILD_SHARED_LIBS=OFF \ -DTUNERS=OFF \ -DCMAKE_BUILD_TYPE=Release \ -DCMAKE_INSTALL_PREFIX=/data/data/com.termux/files/usr cd build make -j8 make install
VC4CL
-
How to OpenCL on a raspberry Pi
There is a rough impl for the 3. https://github.com/doe300/VC4CL
-
Raspberry Pi Zero 2 for image processing.
The Zero 2 still uses VideoCore IV for which we have the documentation and various projects making use of it. There is a open source Mesa driver and also OpenCL support: https://github.com/doe300/VC4CL
- 2022 Mar 14 (Pi Day!) Stickied π ΅π °π & ππππππππ thread - Boot problems? Power supply problems? Display problems? Networking problems? Need ideas? Get help with these and other questions! π¨πΊπ² π―π¬πΉπ¬ ππ°πΉπΊπ»
-
How do I get OpenCL on a Raspberry Pi 1B?
Can't help more than a random repo I found showing its possible https://github.com/doe300/VC4CL
-
Zluda: CUDA on Intel GPUs
Excellent effort. Nvidia has become defacto GPGPU hardware vendor due to CUDA, but I wish it was OpenCL or other general API instead. Even Raspberry Pi's VideoCore has OpenCL support[1].
But a look at HW Acceleration support table at FFmpeg[2] shows why GPGPU Platform API is such a mess. But performance benefits are incredible, using VAAPI for FFmpeg to encode 1080p 2560x1080 screen capture at 60fps reduces CPU usage from 90% to 10% on a old corei5 with intel HD 3000; An old laptop could be perfectly used as an encoding machine for streaming just by using HW Acceleration.
What's funny is that the laptop also has Radeon HD 6490M with 1GB GDDR5 dedicated memory and it's not supported by VAAPI for encoding! Thereby proving the point that GPGPU API/Platform Support are astonishingly messy.
[1]https://github.com/doe300/VC4CL
[2]https://trac.ffmpeg.org/wiki/HWAccelIntro
What are some alternatives?
monolish - monolish: MONOlithic LInear equation Solvers for Highly-parallel architecture
ZLUDA - CUDA on AMD GPUs
llama.cpp - LLM inference in C/C++
ROCm - AMD ROCmβ’ Software - GitHub Home [Moved to: https://github.com/ROCm/ROCm]
limited-systems - Limited Systems
hipcl - OpenCL/SPIR-V implementation of HIP
ArrayFire - ArrayFire: a general purpose GPU library.
hyperpixel4 - Driver for the Pimoroni HyperPixel 4.0" Touchscreen Display
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.