CLBlast Alternatives

Similar projects and alternatives to CLBlast

text-generation-webui

876 35,862 9.9 Python CLBlast VS text-generation-webui

A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
llama.cpp

769 55,846 10.0 C++ CLBlast VS llama.cpp

LLM inference in C/C++
WorkOS

workos.com sponsored

The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
termux-ndk

12 458 3.5 C CLBlast VS termux-ndk

android-ndk for termux
VC4CL

6 721 0.0 C++ CLBlast VS VC4CL

OpenCL implementation running on the VideoCore IV GPU of the Raspberry Pi models
limited-systems

1 138 10.0 CMake CLBlast VS limited-systems

Limited Systems
monolish

1 189 7.8 C++ CLBlast VS monolish

monolish: MONOlithic LInear equation Solvers for Highly-parallel architecture
ArrayFire

6 4,404 7.8 C++ CLBlast VS ArrayFire

ArrayFire: a general purpose GPU library.
InfluxDB

www.influxdata.com sponsored

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better CLBlast alternative or higher similarity.

Suggest an alternative to CLBlast

CLBlast reviews and mentions

Posts with mentions or reviews of CLBlast. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2024-04-06.

Hosting Your Own AI Chatbot on Android Devices
3 projects | dev.to | 6 Apr 2024

git clone https://github.com/CNugteren/CLBlast.git cd CLBlast cmake . cmake --build . --config Release mkdir install cmake --install . --prefix ~/CLBlast/install cp libclblast.so* $PREFIX/lib cp ./include/clblast.h ../llama.cpp
Can't compile llama-cpp-python with CLBLAST
2 projects | /r/LocalLLaMA | 18 Jul 2023

I'm trying to get GPU-Acceleration to work with oobabooga's webui, there it says that I just have to reinstall the llama-cpp-python in the environment and have it compile with CLBLAST.So I have CLBLAST downloaded and unzipped, but when I try to do it with:
How to OpenCL on a raspberry Pi
4 projects | /r/OpenCL | 2 Jul 2023

Which raspberry Pi? For Pi 1 - 3, you can use VC4CL . While it's an impressive effort, it is highly experimental and does not always work as it should. I spent some non-trivial time trying to get CLBlast (a BLAS implementation for OpenCL) working on a 3b+, but there's always something hanging or not giving the right results.
OpenCL in Termux
2 projects | /r/termux | 2 Jun 2023

Install CLBlast: cd git clone https://github.com/CNugteren/CLBlast.git cd CLBlast cmake -B build \ -DBUILD_SHARED_LIBS=OFF \ -DTUNERS=OFF \ -DCMAKE_BUILD_TYPE=Release \ -DCMAKE_INSTALL_PREFIX=/data/data/com.termux/files/usr cd build make -j8 make install
A note from our sponsor - WorkOS
workos.com | 26 Apr 2024

The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning. Learn more →