3d-photo-inpainting VS depthmap2mask

If you are looking to create actual 3d models, the DepthMap extension does have a function to create PLY models with vertex color information, and to render clips with simple camera moves from that extracted 3d scene, including inpainting (as per the 3d-photo-inpainting paper)

The depthmap extension for A1111 has implemented the 3d-photo-inpainting code that is doing that kind of thing. That's what I used to use, first on a Colab, and then adapted for windows so I could run it locally. But it's much more convenient to do it directly from the Automatic1111 WebUI.

But things are even older than stable diffusion.

It's a slightly modified version of https://shihmengli.github.io/3D-Photo-Inpainting/

Thanks! I barely did anything though, just took a deep dream'ed photo made by another artist (Daniel Ambrosi) and passed it through this: https://shihmengli.github.io/3D-Photo-Inpainting/ (github and colab at bottom). Didn't even have to come up with the camera trajectory, was one of the presets in the repo

pretty sure it's this: https://github.com/vt-vl-lab/3d-photo-inpainting

for change background i suggest to use depth2mask.

have you try with dept2mask?

Looks really good. Have you tried img2depth for the texturing? GitHub - Extraltodeus/depthmap2mask: Create masks out of depthmaps in img2img

have you try https://github.com/Extraltodeus/depthmap2mask ?

No, and I don't need to. depthmap2mask works sloppy, I don't like it. It's much better to create mask for "Inpainting" using image-editing software. Here you can see how it's done. https://www.youtube.com/watch?v=dnIYTGW1m8w

Sent to img2img and used Depth Aware img2img mask with the model set to `midas_v21_small` so that I would hopefully affect as little of the image as possible. (after seeing the pants morph, I think it might have been better to just use inpaint)