diffusers VS Dreambooth-SD-optimized

ShivamShrirao's Diffusers Pretrained diffusion models across multiple modalities.

Like the title say I'm trying to fine-tune a model to match a style of a popular manhwa. I'm using the ShivamShrirao Google Colab to accomplish this.

I am running the DreamBooth_Stable_Diffusion.ipynb notebook from ShivamShrirao locally on my machine. Let's say I have trained for 500 iterations and it hasn't converged yet. How do I make it resume training from that iteration so it can do another 500?

My understanding, based on messages from an (alleged) representative of colabs, is that the webui is the problem, not SD itself. This also seems to be the consensus in the comments section of other posts. I have not yet seen a link to colab based webui alternatives so here is something I found from a tutorial. I am certain that there are better alternatives. Anyone have a better idea? This will still probably be useful to other people like me who are just messing around.

I'm running ShivamShrirao's fork of diffusers; ran into a fp16 issue and had to patch in a fix from the main branch ( #1567 ).

I am running Shivam Stable Diffusion Jupyter notebook: diffusers/DreamBooth_Stable_Diffusion.ipynb at main · ShivamShrirao/diffusers · GitHub.

Are you using this one? https://github.com/S

Hey guys im quite new to dream booth i tried the one in stabel diffusion but wasnt really satisfied with the output. Im lloking for a external dreambooth that could be started with anaconda but doesnt need 24 gb Vram i only have 12 Gb. I tried gammagec / Dreambooth-SD-optimizedbut he says you need at least 24 GB

Using this GitHub https://github.com/gammagec/Dreambooth-SD-optimized from this guide https://pastebin.com/xcFpp9Mr

I had pretty good results with 20 images of myself, 200 reg images and 6000 step using https://github.com/gammagec/Dreambooth-SD-optimized.

I use Automatic1111 for SD and then Dreambooth Optimized https://github.com/gammagec/Dreambooth-SD-optimized to do custom models.

Gammagec Dreambooth-SD-optimized - https://github.com/gammagec/Dreambooth-SD-optimized

I use this dreambooth repo to train the SD model. https://github.com/gammagec/Dreambooth-SD-optimized Here's the video that shows how to install it in very good detail. https://youtu.be/TwhqmkzdH3s He uses it to train in a face but you can use it to train in a style as well. I suggest taking about 15 or 20 detailed frames of the video and training it in as a style for the class name. You'll have to experiment with how many training steps to take. I suggest doing 1,000 steps at a time and testing out the model. Also don't leave the default "sks", the researchers forgot that that's a common acronym if you know what I mean. Do something like my_style1 so the model doesn't get confused with something else.

I'm using this guide: https://www.reddit.com/r/StableDiffusion/comments/xpoexy/yet_another_dreambooth_post_how_to_train_an_image/ to train locally with this repo https://github.com/gammagec/Dreambooth-SD-optimized on windows. Needs a 24gb card though.