Our great sponsors
-
-
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
-
-
However ROCm support is Linux only, and will never be ported to Windows. For that, your best hope there would be PyTorch for DirectML... Also, there's no RDNA3 support until ROCm 5.5 (finally?). RDNA is always treated as the red-headed stepchild, so that basically entirely cedes the non-datacenter market. No hobbiests, academics, startups, or anyone else scrappy from starting small and moving up. Without any enthusiasts playing around w/ AMD cards, it's a vicious cycle of no one using it, since there's no community...
One other thing to look into is SHARK. Apparently SHARK LLaMA is possible, for example: https://github.com/nod-ai/SHARK/tree/main/shark/examples/shark_inference/llama
Still: https://github.com/ROCm-Developer-Tools/HIP and https://github.com/RadeonOpenCompute/ROCm are the ways through which eventually they'll get there.
For myself, I use Julia to write my own software (that is run on AMD supercomputer) on Fedora system, using 6800XT. For my experience, everything worked nicely. To install you need to install rocm-opencl package with dnf, AMD Julia package (AMDGPU.jl), add yourself to video group and you are good to go. Also, Julia's KernelAbstractions.jl is a good to have, when writing portable code.
For myself, I use Julia to write my own software (that is run on AMD supercomputer) on Fedora system, using 6800XT. For my experience, everything worked nicely. To install you need to install rocm-opencl package with dnf, AMD Julia package (AMDGPU.jl), add yourself to video group and you are good to go. Also, Julia's KernelAbstractions.jl is a good to have, when writing portable code.
However ROCm support is Linux only, and will never be ported to Windows. For that, your best hope there would be PyTorch for DirectML... Also, there's no RDNA3 support until ROCm 5.5 (finally?). RDNA is always treated as the red-headed stepchild, so that basically entirely cedes the non-datacenter market. No hobbiests, academics, startups, or anyone else scrappy from starting small and moving up. Without any enthusiasts playing around w/ AMD cards, it's a vicious cycle of no one using it, since there's no community...