monolish
CLBlast
Our great sponsors
| monolish | CLBlast | |
|---|---|---|
| 1 | 4 | |
| 189 | 995 | |
| 0.0% | - | |
| 7.8 | 6.6 | |
| 6 months ago | 28 days ago | |
| C++ | C++ | |
| Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
monolish
CLBlast
-
Hosting Your Own AI Chatbot on Android Devices
git clone https://github.com/CNugteren/CLBlast.git cd CLBlast cmake . cmake --build . --config Release mkdir install cmake --install . --prefix ~/CLBlast/install cp libclblast.so* $PREFIX/lib cp ./include/clblast.h ../llama.cpp
-
Can't compile llama-cpp-python with CLBLAST
I'm trying to get GPU-Acceleration to work with oobabooga's webui, there it says that I just have to reinstall the llama-cpp-python in the environment and have it compile with CLBLAST.So I have CLBLAST downloaded and unzipped, but when I try to do it with:
-
How to OpenCL on a raspberry Pi
Which raspberry Pi? For Pi 1 - 3, you can use VC4CL . While it's an impressive effort, it is highly experimental and does not always work as it should. I spent some non-trivial time trying to get CLBlast (a BLAS implementation for OpenCL) working on a 3b+, but there's always something hanging or not giving the right results.
-
OpenCL in Termux
Install CLBlast: cd git clone https://github.com/CNugteren/CLBlast.git cd CLBlast cmake -B build \ -DBUILD_SHARED_LIBS=OFF \ -DTUNERS=OFF \ -DCMAKE_BUILD_TYPE=Release \ -DCMAKE_INSTALL_PREFIX=/data/data/com.termux/files/usr cd build make -j8 make install
What are some alternatives?
oneMKL - oneAPI Math Kernel Library (oneMKL) Interfaces
llama.cpp - LLM inference in C/C++
fms_blas - Lightweight BLAS (and some LAPACK) wrapper.
limited-systems - Limited Systems
BitLib - Provides a bit-vector, an optimized replacement of the infamous std::vector<:b:ool>. In addition to the bit-vector, the library also provides implementations of STL algorithms tailored for bit-vectors.
VC4CL - OpenCL implementation running on the VideoCore IV GPU of the Raspberry Pi models
stdgpu - stdgpu: Efficient STL-like Data Structures on the GPU
ArrayFire - ArrayFire: a general purpose GPU library.
alpaka - Abstraction Library for Parallel Kernel Acceleration :llama:
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
Scalix - Scalix is a data parallel compute library that automatically scales to the available compute resources.
matrix-sized - Generic matrix with statically known size and bindings to C++ linear algebra libraries (Eigen, Spectra).