3d-photo-inpainting VS Real-ESRGAN

If you are looking to create actual 3d models, the DepthMap extension does have a function to create PLY models with vertex color information, and to render clips with simple camera moves from that extracted 3d scene, including inpainting (as per the 3d-photo-inpainting paper)

The depthmap extension for A1111 has implemented the 3d-photo-inpainting code that is doing that kind of thing. That's what I used to use, first on a Colab, and then adapted for windows so I could run it locally. But it's much more convenient to do it directly from the Automatic1111 WebUI.

But things are even older than stable diffusion.

It's a slightly modified version of https://shihmengli.github.io/3D-Photo-Inpainting/

Thanks! I barely did anything though, just took a deep dream'ed photo made by another artist (Daniel Ambrosi) and passed it through this: https://shihmengli.github.io/3D-Photo-Inpainting/ (github and colab at bottom). Didn't even have to come up with the camera trajectory, was one of the presets in the repo

pretty sure it's this: https://github.com/vt-vl-lab/3d-photo-inpainting

It's not exactly what you're after, as it's anime specific and you need to process the video yourself (eg disassemble to frames, run the upscaler, then assemble back to a movie file), but Real-ESRGAN is really good:

https://github.com/xinntao/Real-ESRGAN/

It's pretty brilliant for cleaning up very old, low resolution anime.

Just a note you can run upscaling on your home desktop with Real-ESRGAN:

https://github.com/xinntao/Real-ESRGAN

Maybe Real-ESRGAN is a good fit? Even tho it's a couple of years old

I'm glad you noticed! I upscaled the icon from the wiki using Real-ESRGAN's 4xplus anime model, then photoshopped out the text. Worked far better than waifu2x.

A: Try using High-res Fix and R-ESRGAN 4x+ Anime6B as upscaler

Maybe try this one https://github.com/xinntao/Real-ESRGAN it may work even better.

Screenshotted from the official music video, upscaled to 4k using a state of the art ML model.

Do you happen to remember which chapter has that "scene"? You could also try to enhance it yourself, I did it using Real-ESRGAN, which is really easy to use.