ControlNet-v1-1-nightly VS style2paints

1- https://github.com/lllyasviel/ControlNet-v1-1-nightly/issues/89

Install ControlNet and download the models you want to use (canny/depth/openpose should be enough for this): https://github.com/lllyasviel/ControlNet-v1-1-nightly

you can find the previous version on their git and if it's a previous version of v1.1 then you probably have to search for the right branch on the new git version and download that

Stable Diffusion: https://huggingface.co/runwayml/stable-diffusion-v1-5 with ControlNet extension: https://github.com/lllyasviel/ControlNet-v1-1-nightly running on Automatic1111 web UI: https://github.com/AUTOMATIC1111/stable-diffusion-webui

Sure thing, after testing midjourney a bit I found out that yhe quality of images produced is best but you have zero control on over what is produced. The big breakthrough here is ControlNet which is a Stable Diffusion extension that makes you control the initial noise based on image inputs (or at least this is what i understand) more on it here: https://github.com/lllyasviel/ControlNet-v1-1-nightly

https://github.com/lllyasviel/ControlNet-v1-1-nightly/issues/61 it seems get removed as duplicated.

This is lineart, the sketch model is still not here: https://github.com/lllyasviel/style2paints/tree/master/V5_preview

Older versions of style2paints have been available for years: https://github.com/lllyasviel/style2paints .

Link, for anyone interested.

this could help with more efficiency : https://github.com/lllyasviel/style2paints

Basically this

For anyone curious, the AI I used to create the images above is "style2paints V4.5" and can be found in this repo. All credit goes to lllyasviel ;)

Step 1: Use Style2Paints to generate a bunch of shades of Illustration you want to paint.

u/PrizeAcanthisitta228 and others who want to give this a shot, consider also checking out Style2Paints https://github.com/lllyasviel/style2paints which uses AI and user input to add colours based on where you choose to put colours!

Yes, after Alice from Alice in wonderland, there’s a few manga guys.

Later, this old man not anime style is presented: https://github.com/lllyasviel/style2paints/raw/master/temps/...