AMD Funded a Drop-In CUDA Implementation Built on ROCm: It's Open-Source

1. ZLUDA

   1 42 11,321 7.2 Rust

   CUDA on non-NVIDIA GPUs

   

   From the same repo, I found this excellent, well-written architecture document: https://github.com/vosen/ZLUDA/blob/master/ARCHITECTURE.md

   I love the direct, "no bullshit" style of writing.

   Some gems:

   > Anyone familiar with C++ will instantly understand that compiling it is a complicated affair.

   > Additionally CUDA allows, to a large degree, mixing CPU code and GPU code. What does all this complexity mean for ZLUDA? Absolutely nothing

   > Since an application can dynamically link to either Driver API or Runtime API, it would seem that ZLUDA needs to provide both. In reality very few applications dynamically link to Runtime API. For the vast majority of applications it's sufficient to provide Driver API for dynamic (runtime) linking.

2. InfluxDB

   www.influxdata.com featured

   InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.

   

3. InvokeAI

   2 241 25,098 10.0 TypeScript

   Invoke is a leading creative engine for Stable Diffusion models, empowering professionals, artists, and enthusiasts to generate and create visual media using the latest AI-driven technologies. The solution offers an industry leading WebUI, and serves as the foundation for multiple commercial products.

   

   I actually used the rocm/pytorch image you also linked.

   I'm not sure what you're pointing to with your reference to the Fedora-based images. I'm quite happy with my NixOS install and really don't want to switch to anything else. And as long as I have the correct kernel module, my host OS really shouldn't matter to run any of the images.

   And I'm sure it can be made to work with many base images, my point was just that the dependency management around pytorch was in a bad state, where it is extremely easy to break.

   > Anyways, hopefully this PR fixes the immediate issue: https://github.com/invoke-ai/InvokeAI/pull/5714/files

   It does! At least for me. It is my PR after all ;)

4. ROCm

   3 19 21 10.0 HTML

   Discontinued ROCm Website [Moved to: https://github.com/ROCm/ROCm.github.io] (by ROCm)

   

   ROCm is not spelled out anywhere in their documentation and the best answers in search come from Github and not AMD official documents

   "Radeon Open Compute Platform"

   https://github.com/ROCm/ROCm/issues/1628

   And they wonder why they are losing. Branding absolutely matters.

5. Deepspeed-Windows

   4 1 37 7.6 C++

   Deepspeed windows information

   

   I just went through this this weekend - If you're running in Windows and want to use deepspeed, you have to still use Cuda 12.1 because deepspeed 13.1 is the latest that works with 12.1. There's no deepspeed for windows that works with 12.3.

   I tried to get it working this weekend but it was a huge PITA so I switched to putting everything into WSL2 then in arch on there pytorch etc in containers so I could flip versions easily.

   I'm still working on that part, halfway into it my WSL2 completely broke and I had to reinstall windows. The p9 networking stopped working.

   https://github.com/S95Sedan/Deepspeed-Windows

6. chipStar

   5 6 272 9.7 LLVM

   chipStar is a tool for compiling and running HIP/CUDA on SPIR-V via OpenCL or Level Zero APIs.

   

   There is already a work-in-progress implementation of HIP on top of OpenCL https://github.com/CHIP-SPV/chipStar and the Mesa RustiCL folks are quite interested in getting that to run on top of Vulkan.

7. stable-diffusion-webui

   6 2,814 152,625 7.5 Python

   Stable Diffusion web UI

   

   I would love to be able to have a native stable diffusion experience, my rx 580 takes 30s to generate a single image. But it does work after following https://github.com/AUTOMATIC1111/stable-diffusion-webui/wiki...

   I got this up and running on my windows machine in short order and I don't even know what stable diffusion is.

   But again, it would be nice to have first class support to locally participate in the fun.

8. Cgml

   7 31 56 8.6 C++

   GPU-targeted vendor-agnostic AI library for Windows, and Mistral model implementation.

   

   I did a few times with Direct3D 11 compute shaders. Here’s an open-source example: https://github.com/Const-me/Cgml

   Pretty sure Vulkan gonna work equally well, at the very least there’s an open source DXVK project which implements D3D11 on top of Vulkan.

9. SaaSHub

   www.saashub.com featured

   SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

   

10. ncnn

    8 13 21,474 9.4 C++

    ncnn is a high-performance neural network inference framework optimized for the mobile platform

    

    ncnn uses Vulkan for GPU acceleration, I've seen it used in a few projects to get AMD hardware support.

    https://github.com/Tencent/ncnn

11. hipDNN

    9 1 42 0.0 C++

    A thin wrapper around miOpen and cuDNN

    

12. ROCm-docker

    10 3 466 6.5 Shell

    Dockerfiles for the various software layers defined in the ROCm software platform

    

    https://rocm.docs.amd.com/projects/install-on-linux/en/lates... links to ROCm/ROCm-docker: https://github.com/ROCm/ROCm-docker which is the source of docker.io/rocm/rocm-terminal: https://hub.docker.com/r/rocm/rocm-terminal :

      docker run -it --device=/dev/kfd --device=/dev/dri --group-add video rocm/rocm-terminal

13. bazzite

    11 32 5,347 9.9 Shell

    Bazzite makes gaming and everyday use smoother and simpler across desktop PCs, handhelds, tablets, and home theater PCs.

    

    https://github.com/ublue-os/bazzite/blob/main/Containerfile#... has, in addition to fan and power controls, automatic updates on desktop, supergfxctl, system76-scheduler, and an fsync kernel:

      rpm-ostree install rocm-hip \

14. config

    12 4 53 8.3 Shell

    Discontinued A layer to provide configuration files (udev rules, service units, etc) (by ublue-os)

    

    https://github.com/ublue-os/config/blob/main/build/ublue-os-...

    There's a default `distrobox` with pytorch in ublue-os/config//build/ublue-os-just/etc-distrobox/apps.ini:

15. pytorch

    13 4 227 0.0 Python

    Tensors and Dynamic neural networks in Python with strong GPU acceleration (by ROCm)

    

    https://github.com/ROCm/pytorch/blob/main/Dockerfile

    The ublue-os (and so also bazzite) OCI host image Containerfile has Sunshine installed; which is a 4k HDR 120fps remote desktop solution for gaming.

    ublue-os/config//Containerfile:

16. Sunshine

    14 435 25,319 9.6 C++

    Self-hosted game stream host for Moonlight.

    

17. SaaSHub

    www.saashub.com featured

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    

Suggest a related project