limited-systems
Limited Systems (by wimvanderbauwhede)
CLBlast
Tuned OpenCL BLAS (by CNugteren)
limited-systems | CLBlast | |
---|---|---|
1 | 4 | |
138 | 1,002 | |
- | - | |
10.0 | 6.6 | |
over 1 year ago | about 2 months ago | |
CMake | C++ | |
- | Apache License 2.0 |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
limited-systems
Posts with mentions or reviews of limited-systems.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-07-02.
CLBlast
Posts with mentions or reviews of CLBlast.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2024-04-06.
-
Hosting Your Own AI Chatbot on Android Devices
git clone https://github.com/CNugteren/CLBlast.git cd CLBlast cmake . cmake --build . --config Release mkdir install cmake --install . --prefix ~/CLBlast/install cp libclblast.so* $PREFIX/lib cp ./include/clblast.h ../llama.cpp
-
Can't compile llama-cpp-python with CLBLAST
I'm trying to get GPU-Acceleration to work with oobabooga's webui, there it says that I just have to reinstall the llama-cpp-python in the environment and have it compile with CLBLAST.So I have CLBLAST downloaded and unzipped, but when I try to do it with:
-
How to OpenCL on a raspberry Pi
Which raspberry Pi? For Pi 1 - 3, you can use VC4CL . While it's an impressive effort, it is highly experimental and does not always work as it should. I spent some non-trivial time trying to get CLBlast (a BLAS implementation for OpenCL) working on a 3b+, but there's always something hanging or not giving the right results.
-
OpenCL in Termux
Install CLBlast: cd git clone https://github.com/CNugteren/CLBlast.git cd CLBlast cmake -B build \ -DBUILD_SHARED_LIBS=OFF \ -DTUNERS=OFF \ -DCMAKE_BUILD_TYPE=Release \ -DCMAKE_INSTALL_PREFIX=/data/data/com.termux/files/usr cd build make -j8 make install
What are some alternatives?
When comparing limited-systems and CLBlast you can also consider the following projects:
VC4CL - OpenCL implementation running on the VideoCore IV GPU of the Raspberry Pi models
monolish - monolish: MONOlithic LInear equation Solvers for Highly-parallel architecture
llama.cpp - LLM inference in C/C++
ArrayFire - ArrayFire: a general purpose GPU library.
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.