first-order-model VS stable-diffusion-webui-depthmap-script

First Order Motion Model/Thin Plate Spline (Animate Single images realistically using a driving video) https://github.com/AliaksandrSiarohin/first-order-model (FOMM - Animate still images using driving videos) https://github.com/yoyo-nb/Thin-Plate-Spline-Motion-Model (Thin Plate Spline - Likely just a repost of FOMM but with better documentation and tutorials on YouTube) https://drive.google.com/drive/folders/1PyQJmkdCsAkOYwUyaj_l-l0as-iLDgeH (FOMM/Thin Plate Checkpoints) https://disk.yandex.com/d/lEw8uRm140L_eQ (FOMM/Thin Plate Checkpoints mirror) -------3D ANIMATION--------

GitHub - AliaksandrSiarohin/first-order-model: This repository contains the source code for the paper First Order Motion Model for Image Animation

Not sure about whatever bot op is specifically using, but you can use this software to achieve the same result https://github.com/AliaksandrSiarohin/first-order-model

I think the novel and interesting tech is still happening, its just that without the colorful ads for it on TV, and without the software being packaged up and sold with pretty box art that you can physically hold, it doesn't feel as much like a capital-E Experience. It's probably the Internet's fault that we don't do things like that anymore, but the upside is that we now have access to so many ideas and applications from all over, even ones that aren't commercially viable.

Some that look exciting to me are: an AI that lets you animate still photos realistically [1], a simple website that guides you to discover new parks, eateries, and other places near you [2], an AI that colorizes old black-and-white photos/video [3], a Street View style map of the game world from "The Legend of Zelda: Breath of the Wild", with some 1st person 360 degree photos [4], and a tiny game engine that lets you distribute your whole game physically via printed QR codes [5].

If marketing and graphic design people ever felt like getting together to do some 'side projects', I vote that they should make print ads for apps/websites that they like :)

[1] https://github.com/AliaksandrSiarohin/first-order-model

[2] https://randomlocation.xyz (https://randomlocation.xyz/help.txt for customization)

[3] https://github.com/jantic/DeOldify

[4] https://nassimsoftware.github.io/zeldabotwstreetview/

[5] https://github.com/kesiev/rewtro

Ai Used https://github.com/AliaksandrSiarohin/first-order-model

First Order Model

First Order Motion Model (Easy): You can give it an input image and a source video, and the movements from the video will be copied to the image. It has some janky-ness and I would recommend using an ai upscaller afterwards because the resolution isn't that high https://github.com/AliaksandrSiarohin/first-order-model

The guide on the github page for the extension is OK: https://github.com/thygate/stable-diffusion-webui-depthmap-script

New to SD. I'm trying to get an extension to work (https://github.com/thygate/stable-diffusion-webui-depthmap-script) but opposite to the tutorials the "depth" tab doesn't show after installation. Anyone who can help locate the problem? Thanks!

You can use this extension to generate stereoscopic images . . . I don't (yet) dabble in video, so I don't know what it'll do there. I've done a ton of stereo pics with it. My fascination sort of comes and goes. You can do cross-eyed or parllel view as well as red/cyan anaglyphs.

Option 8. Use img2img of existing 360 HDRIs, extract their depth maps with the depth extension. Use that as a displacement map on a sphere in Blender, similarly to this, with the refurbished HDRI as an image texture, then take screenshots from a position close to the center of the sphere. You are limited to staying close to the center in order to avoid distortion, but now you have 360 degrees of consistent freedom for a particular scene. If you have 2 or more HDRIs of the same place, even better. You could also combine this with the 3D environments of the other options to use 360 renders as bases for the img2img.

you have another automatic 1111 extension that allow you to create there also the 3d file, but this consume a lot of vram https://github.com/thygate/stable-diffusion-webui-depthmap-script

If you're using A1111 webui there is the depthmap2mask extension which you can install from the extensions tab. It will add a depth tab which will allow you to create 16-bit depth maps among many other things.

actually it is very easy to do. What you need is install extension for Stable Diffusion webUI (https://stable-diffusion-art.com/install-windows/) . This extension will generate stereo for you automatically. Name is Depth. (https://github.com/thygate/stable-diffusion-webui-depthmap-script)

You can do this inside of a1111 as well with this extension https://github.com/thygate/stable-diffusion-webui-depthmap-script