Our great sponsors
-
diffusers
🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
detectron2
Detectron2 is a platform for object detection, segmentation and other visual recognition tasks.
In `diffusers` implementations (like InvokeAI) its pretty easy: https://github.com/huggingface/diffusers/blob/42beaf1d23b5cc...
But I also compile the VAE and some other modules, I will reply again later when I can look at my local code.
For the Automatic1111 repo (and presumably other original Stability AI implementations), I just add `m.model
= torch.compile(m.model)` here: https://github.com/AUTOMATIC1111/stable-diffusion-webui/blob...
I tried changing the options in the config dict one by one, but TBH nothing seems to make a significant difference.
I also havent messed with compiling LORA training yet, as I havent done it often as is sufficiently fast, but I'm sure it could be done.
This is the master tracking list for MPS operator support: https://github.com/pytorch/pytorch/issues/77764
I could fine-tune a Detectron2 model a few months ago using PyTorch and MPS backend [1]. I'd be interested if it's working yet.
https://github.com/facebookresearch/detectron2/issues/4342