Our great sponsors
-
AITemplate
AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (NVIDIA GPU) and MatrixCore (AMD GPU) inference.
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
For cross-vendor AI, Meta's AITemplate may be the best, as it has support for both CUDA and HIP. However, I haven't tested it so can't tell how easy it is to get running.
This might not apply in your circumstance where you are required to use dockerized model, but if one just wants pytorch working in a python3 virtual environment, I wonder if instruction on the front page of pytorch.org "Just Works"?
Setting up Stable Diffusion directory and conda environment: Go to the main stable diffusion repo https://github.com/CompVis/stable-diffusion download their environment.yaml file (raw), put it into the StableDiffusion folder (for the above command it'll be at $HOME/StableDiffusion)