clvk
alpaka
clvk | alpaka | |
---|---|---|
4 | 1 | |
315 | 324 | |
- | 2.2% | |
8.8 | 9.2 | |
7 days ago | 6 days ago | |
C++ | C++ | |
Apache License 2.0 | Mozilla Public License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
clvk
-
LangChain / LlamaCpp on M1 GPU (MPS)?
I tried very similar thing. My purpose was to run llama-cpp-python with CLBlast GPU acceleration via clvk on VulkanSDK on my M1 Max computer. I downloaded VulkanSDK for macOS, cloned clvk(https://github.com/kpet/clvk) and CLBlast. Build was successful but there is a problem; when clCreateCommandQueue function was called with CL_QUEUE_OUT_OF_ORDER_EXEC_MODE_ENABLE option(in ggml-opencl.c of llama.cpp) , an error was happened and I do not know how to handle it.
- Resources for Vulkan GPGPU searched
-
Cross Platform GPU-Capable Framework?
OpenCL really is your best bet for a cross-platform GPU-capable framework. OpenCL 3.0 cleared out a lot of the cruft from OpenCL 2.x so it's seeing a lot more adoption. The most cross-platform solution is still OpenCL 1.2, largely for MacOS, but OpenCL 3.0 is becoming more and more common for Windows and Linux and multiple devices. Even on platforms without native OpenCL support there are compatibility layers that implement OpenCL on top of DirectX (OpenCLOn12) or Vulkan (clvk and clspv).
-
How does GPU programming work?
What we really need is CLVK, but it seems pretty limited. I'd prefer a clang based compiler which can accept opencl c++ personally, because a brand new compiler is not ideal
alpaka
-
Cross Platform GPU-Capable Framework?
Note that Kokkos uses CUDA, OpenMP and also SYCL in order to have a wide range of targets. I'd also suggest taking a look at Alpaka https://github.com/alpaka-group/alpaka which is similar in some ways.
What are some alternatives?
clspv - Clspv is a compiler for OpenCL C to Vulkan compute shaders
kompute - General purpose GPU compute framework built on Vulkan to support 1000s of cross vendor graphics cards (AMD, Qualcomm, NVIDIA & friends). Blazing fast, mobile-enabled, asynchronous and optimized for advanced GPU data processing usecases. Backed by the Linux Foundation.
GLSL - GLSL Shading Language Issue Tracker
vuh - Vulkan compute for people
VkFFT - Vulkan/CUDA/HIP/OpenCL/Level Zero/Metal Fast Fourier Transform library
OpenCLOn12 - The OpenCL-on-D3D12 mapping layer
ParallelReductionsBenchmark - Thrust, CUB, TBB, AVX2, CUDA, OpenCL, OpenMP, SyCL - all it takes to sum a lot of numbers fast!
ocl - OpenCL for Rust
ginkgo - Numerical linear algebra software package