DeOldify VS sd-webui-controlnet

The old method is simple. All you need to do is running DeOldify with a colab notebook. Then you can pick any neural networks you want for upscale and frame interpolation. A lot of people use dain-app, but I find rife faster and easier to use.

Today, we’re talking to a very special “Software Guy, currently digging deep into GANs” — The author of DeOldify: Jason Antic.

I think the novel and interesting tech is still happening, its just that without the colorful ads for it on TV, and without the software being packaged up and sold with pretty box art that you can physically hold, it doesn't feel as much like a capital-E Experience. It's probably the Internet's fault that we don't do things like that anymore, but the upside is that we now have access to so many ideas and applications from all over, even ones that aren't commercially viable.

Some that look exciting to me are: an AI that lets you animate still photos realistically [1], a simple website that guides you to discover new parks, eateries, and other places near you [2], an AI that colorizes old black-and-white photos/video [3], a Street View style map of the game world from "The Legend of Zelda: Breath of the Wild", with some 1st person 360 degree photos [4], and a tiny game engine that lets you distribute your whole game physically via printed QR codes [5].

If marketing and graphic design people ever felt like getting together to do some 'side projects', I vote that they should make print ads for apps/websites that they like :)

[1] https://github.com/AliaksandrSiarohin/first-order-model

[2] https://randomlocation.xyz (https://randomlocation.xyz/help.txt for customization)

[3] https://github.com/jantic/DeOldify

[4] https://nassimsoftware.github.io/zeldabotwstreetview/

[5] https://github.com/kesiev/rewtro

A crucial step for achieving stable diffusion controlnet settings is the installation of the controlnet extension in Google Colab. Whether on a Windows PC or Mac, installing controlnet is vital for stable diffusion of human pose details. Additionally, updating the controlnet extension is necessary to maintain stability and achieve the desired results in OpenPose model. To install the v1.1 controlnet extension, go to the “extensions” tab and install it from this URL: https://github.com/Mikubill/sd-webui-controlnet. If you already have v1 controlnets installed, delete the folder from stable-diffusion-webui/extensions/. Install the v1.

1.1.420 Image-wise ControlNet and StyleAlign

I opened a request thread on ControlNet GitHub you can give a support : https://github.com/Mikubill/sd-webui-controlnet/issues/2319

It has been possible for 7 months now

I sometimes use a very similar technique in Cinema4d (here is a link to a c4d file with preset materials referencing proper colors for Semantic Segmentation if any other c4d user wants to try it), but yours is a much more accessible solution as it's free and it's accessible online.

There are models available that give you more control - in some senses, at least.

For example, you can use Stable Diffusion with 'ControlNet' [1] where for example, you can input an 'openpose' to choose the pose of people in the scene.

There's also a 'Regional Prompter' [2] which lets you use different prompts for different areas of the image, giving you some control over the composition.

You can also use 'inpainting' to regenerate select parts of your image if, for example, you don't like the shape of the clouds.

Of course this stuff isn't perfect - for example, you'll get hands with the wrong number of fingers sometimes, no matter what you specify :)

[1] https://github.com/Mikubill/sd-webui-controlnet