diffusion-models-class VS sd_dreambooth_extension

When you use stable diffusion, you can adjust the classifier free guidance scale to control how much it follows the input prompt. From what I understand(check https://github.com/huggingface/diffusion-models-class/tree/main/unit3), what cfg does is that it generates an unconditional image and an image conditional on the text prompt, and then scale up the difference.

https://huggingface.co/learn/nlp-course/ https://huggingface.co/docs/transformers (go through the task guide) https://github.com/huggingface/diffusion-models-class http://d2l.ai/ https://www.youtube.com/watch?v=VMj-3S1tku0&list=PLAqhIrjkxbuWI23v9cThsA9GvCAUhRvKZ

I couldn't understand the original paper(havent done meth in a long time). This blog post and short course help me to understand.

The Diffusion Models Course is another good resource to learn more technical details.

Next, you need to become familiar with the diffusion model. I recommend this huggingface's course(https://github.com/huggingface/diffusion-models-class) because it is very high quality and you will learn while using diffusers. At first glance, it may not seem directly related to this game, but in my case, knowing what is happening in diffusers helped me in many ways: trial and error, inspiration for ideas, etc. I had no knowledge of pytorch (the deep learning library used for diffusers), so I also took this course (https://www.udacity.com/course/deep-learning-pytorch--ud188) which was in the prerequisites for that huggingface's course. It was also very good.

Hugging Face Dreambooth Hackaton details

Details: https://github.com/huggingface/diffusion-models-class/blob/main/hackathon/README.md

I am trying to use StableDiffusion via AUTOMATIC1111 with the Dreambooth extension

When I first attempted SD training, I was very frustrated. It wasn't until I found this obscure forum thread on Github that I actually started producing great results with Dreambooth. Because I have such satisfactory results, I'm very reluctant to beat my brains against LoRa and its related training techniques. I gave up trying to train TI embeddings a long time ago. And I never figured out how to train or how to use hypernetworks. I've only been able to get good results with Dreambooth directly because of that thread I linked above. I make LoRas by extracting them from Dreambooth-trained checkpoints. And I have no idea if I'm doing the extractions the right way or not.

Getting the same with automatic1111 and sd_dreambooth extension. Check out more here in the issues log: https://github.com/d8ahazard/sd_dreambooth_extension/issues/1266

It's several moths old and many things have changed. But the spreadsheet available through this thread on Github has been indispensable for me when I train Dreambooth models. I'm astounded no one talks about it. I bring it up all the time. The research presented there should be continued. I'd love to see similar research done for SD v2.1.

Training rate is paramount. Read this Github thread.

https://github.com/d8ahazard/sd_dreambooth_extension/discussions/547/ (in depth training principles understanding)

sd_dreambooth_extension https://github.com/d8ahazard/sd_dreambooth_extension.git main 926ae204 Fri Mar 31 15:12:45 2023 unknown

also the Dreambooth extension supports API (https://github.com/d8ahazard/sd_dreambooth_extension/blob/main/scripts/api.py) so i'm not sure where do you get those news :/