rocm-gfx803
openvino
rocm-gfx803 | openvino | |
---|---|---|
7 | 17 | |
167 | 5,996 | |
- | 4.4% | |
1.1 | 10.0 | |
about 1 year ago | 4 days ago | |
C++ | ||
- | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
rocm-gfx803
- ROCm gfx803 archlinux
-
My brother is giving away a PC he built with 8 AMD Radeon RX Vega x64 GPUs (8GB ram). I've only ever done ML on Nvidia cards. Is there anything I can do with these?
That specific card has current support for rocm and that is supported by at least tensorflow and torch, plus many other less known/used libraries like cupy, although you are correct in the fact that support sucks in the long run, I have a GPU that is known to be useful and that has continued COMMUNITY support because AMD cut the support with rocm 4.0, thanks to Xuhuisheng for the patch to make the rx580 work with current rocm despite AMD lack of support, what open source can accomplish https://github.com/xuhuisheng/rocm-gfx803
-
Automatic111 - Torch is not able to use GPU. Help!
You'll also need to compile pytorch and torchvision for gfx803, although I recommend you install the whl files from here inside your venv because it's a massive pain to compile them on non-Ubuntu (I tried)
-
Image Creation Time for each GPU.
I followed the guide from here: https://github.com/xuhuisheng/rocm-gfx803
-
I *think* it's impossible to run SD on an RX 570 (and probably below?)
There is an unofficial build of ROCm 5.2.0 + pytorch + torchvision with GFX8 support added back in. I have no idea if it works. Perhaps someone who knows Docker/Conda could get SD working with those files.
- Run Stable Diffusion on Intel CPUs
openvino
- FLaNK Stack 05 Feb 2024
- QUIK is a method for quantizing LLM post-training weights to 4 bit precision
- Intel OpenVINO 2023.1.0 released
- Intel OpenVINO 2023.1.0 released, open-source toolkit for optimizing and deploying AI inference
- OpenVINO 2023.1.0 released
- [N] Intel OpenVINO 2023.1.0 released, open-source toolkit for optimizing and deploying AI inference
-
Powering Anomaly Detection for Industry 4.0
Anomalib is an open-source deep learning library developed by Intel that makes it easy to benchmark different anomaly detection algorithms on both public and custom datasets, all by simply modifying a config file. As the largest public collection of anomaly detection algorithms and datasets, it has a strong focus on image-based anomaly detection. It’s a comprehensive, end-to-end solution that includes cutting-edge algorithms, relevant evaluation methods, prediction visualizations, hyperparameter optimization, and inference deployment code with Intel’s OpenVINO Toolkit.
What are some alternatives?
stable-diffusion-webui-docker - Easy Docker setup for Stable Diffusion with user-friendly UI
TensorRT - NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.
AITemplate - AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (NVIDIA GPU) and MatrixCore (AMD GPU) inference.
deepsparse - Sparsity-aware deep learning inference runtime for CPUs
stable-diffusion-cpu
mediapipe - Cross-platform, customizable ML solutions for live and streaming media.
stable-diffusion - Go to lstein/stable-diffusion for all the best stuff and a stable release. This repository is my testing ground and it's very likely that I've done something that will break it.
DeepSpeed-MII - MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.
neural-compressor - SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime
stable_diffusion.openvino
nebuly - The user analytics platform for LLMs