sd-webui-controlnet VS sd-dynamic-prompts

A crucial step for achieving stable diffusion controlnet settings is the installation of the controlnet extension in Google Colab. Whether on a Windows PC or Mac, installing controlnet is vital for stable diffusion of human pose details. Additionally, updating the controlnet extension is necessary to maintain stability and achieve the desired results in OpenPose model. To install the v1.1 controlnet extension, go to the “extensions” tab and install it from this URL: https://github.com/Mikubill/sd-webui-controlnet. If you already have v1 controlnets installed, delete the folder from stable-diffusion-webui/extensions/. Install the v1.

1.1.420 Image-wise ControlNet and StyleAlign

I opened a request thread on ControlNet GitHub you can give a support : https://github.com/Mikubill/sd-webui-controlnet/issues/2319

It has been possible for 7 months now

I sometimes use a very similar technique in Cinema4d (here is a link to a c4d file with preset materials referencing proper colors for Semantic Segmentation if any other c4d user wants to try it), but yours is a much more accessible solution as it's free and it's accessible online.

There are models available that give you more control - in some senses, at least.

For example, you can use Stable Diffusion with 'ControlNet' [1] where for example, you can input an 'openpose' to choose the pose of people in the scene.

There's also a 'Regional Prompter' [2] which lets you use different prompts for different areas of the image, giving you some control over the composition.

You can also use 'inpainting' to regenerate select parts of your image if, for example, you don't like the shape of the clouds.

Of course this stuff isn't perfect - for example, you'll get hands with the wrong number of fingers sometimes, no matter what you specify :)

[1] https://github.com/Mikubill/sd-webui-controlnet

I found some of the images I remember from the article I'm trying to find, buried deep in the StylePile Extension , but sadly not the article itself. The Wildcards Directory Extension looks promising as well, although it seems only tangentially related to what I'm looking for.

While not really relevant to the issue I am trying to use a program to build wildcards to use with sd-dynamic-prompts. That is why the code contains a few weird things in how it outputs the files and why it restricts certain characters on input.

wildcards already done https://github.com/adieyal/sd-dynamic-prompts/blob/main/collections/nsp/nsp/nationality.txt

Body types is on my to-do list if I can make it work. As for custom categories, probably not. Honestly if that's what you want you should use a straightforward wildcard extension like Dynamic Prompts. Try it, it's fantastic.

First step: install the dynamic prompt extension (you may like some of its extra features as they fall directly in the type of work you are doing) or the barebones Wildcard extension that was initially released by A1111 himself.

This is an experimental attempt in order to avoid "same face"/copypaste effect of having multiple subjects. It's simply using adetailer and dynamic prompt extension to create a group people with different clothing/expressions. The prompt in both txt2img and adetailer can be changed according to what the project need.

https://github.com/adieyal/sd-dynamic-prompts let you add random (or controlled) info to your prompt