vuh
clvk
Our great sponsors
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
vuh
-
GLSL shaders for OpenCL
The only one that is relatively lightweight (and doesn't have dependencies) is vuh (https://github.com/Glavnokoman/vuh) that looks unsupported.
- Resources for Vulkan GPGPU searched
-
Blender 3.0 takes support for AMD GPUs to the next level
Don't try to use it directly, you need a higher level library.
https://github.com/KomputeProject/kompute seems like what's taking off. There are also smaller ones like https://github.com/Glavnokoman/vuh etc.
clvk
-
LangChain / LlamaCpp on M1 GPU (MPS)?
I tried very similar thing. My purpose was to run llama-cpp-python with CLBlast GPU acceleration via clvk on VulkanSDK on my M1 Max computer. I downloaded VulkanSDK for macOS, cloned clvk(https://github.com/kpet/clvk) and CLBlast. Build was successful but there is a problem; when clCreateCommandQueue function was called with CL_QUEUE_OUT_OF_ORDER_EXEC_MODE_ENABLE option(in ggml-opencl.c of llama.cpp) , an error was happened and I do not know how to handle it.
- Resources for Vulkan GPGPU searched
-
Cross Platform GPU-Capable Framework?
OpenCL really is your best bet for a cross-platform GPU-capable framework. OpenCL 3.0 cleared out a lot of the cruft from OpenCL 2.x so it's seeing a lot more adoption. The most cross-platform solution is still OpenCL 1.2, largely for MacOS, but OpenCL 3.0 is becoming more and more common for Windows and Linux and multiple devices. Even on platforms without native OpenCL support there are compatibility layers that implement OpenCL on top of DirectX (OpenCLOn12) or Vulkan (clvk and clspv).
-
How does GPU programming work?
What we really need is CLVK, but it seems pretty limited. I'd prefer a clang based compiler which can accept opencl c++ personally, because a brand new compiler is not ideal
What are some alternatives?
ocl - OpenCL for Rust
clspv - Clspv is a compiler for OpenCL C to Vulkan compute shaders
GLSL - GLSL Shading Language Issue Tracker
kompute - General purpose GPU compute framework built on Vulkan to support 1000s of cross vendor graphics cards (AMD, Qualcomm, NVIDIA & friends). Blazing fast, mobile-enabled, asynchronous and optimized for advanced GPU data processing usecases. Backed by the Linux Foundation.
rust-gpu - 🐉 Making Rust a first-class language and ecosystem for GPU shaders 🚧
alpaka - Abstraction Library for Parallel Kernel Acceleration :llama:
cuda-api-wrappers - Thin C++-flavored header-only wrappers for core CUDA APIs: Runtime, Driver, NVRTC, NVTX.
VkFFT - Vulkan/CUDA/HIP/OpenCL/Level Zero/Metal Fast Fourier Transform library
uVkCompute - A micro Vulkan compute pipeline and a collection of benchmarking compute shaders