artistic-videos VS After-Diffusion

It's been figured out back in the GAN days, then applied to disco diffusion, and then finally stable warp diffusion, although locked behind a patreon paywall. There are also extensions for A1111 Webui like this temporal kit but it's mostly based on ebsynth and doesn't do true temporal warping that I have in mind with these other links.

What you are thinking of is called "temporal coherence", and it was used all the way back in 2016 to create videos with neural style transfer. Example: https://github.com/manuelruder/artistic-videos

Mostly using this repo: https://github.com/manuelruder/artistic-videos

You should definitely have the option to toggle optical flow on/off in your plugin if this is what it looks like with it off. I've come across it before while using this old beauty, but I'm guessing that is the old and messy version you mentioned further up the thread.

There are a lot of works in video style transfer (ex: https://github.com/manuelruder/artistic-videos, https://github.com/manuelruder/fast-artistic-videos, https://github.com/sunshineatnoon/LinearStyleTransfer) but with any of this you wont achive such quality out of the box. Video above is a commercial product with a lot of tricks hidden inside it, witch only creators are aware of.

I'm very much open to feedback, so if you get a chance to check it out, or you have any suggestions outright, feel free to let me know! You can find more info and get the extension here!

Side Note: If you DO use Adobe products, feel free to use this extension I had chatGPT help me build, which is meant to integrate the webUI with After Effects more directly, so you don't have to constantly import/export and change windows. It offers TXT2IMG, IMG2IMG, IMG2IMG Inpaint, Inpaint Sketch, multi-Controlnet, and more, directly in After Effects. I'm maintaining it as open source, following suit with the plethora of other SD related implementations, so you'll always have free access to it.

Jump into the future of Adobe After Effects! (https://github.com/Trentonom0r3/After-Diffusion/tree/Beta-Branch). I'm working around the clock to have this release ready in the next two weeks, so stay tuned!

Trentonom0r3/After-Diffusion: A CEP Extension for Adobe After Effects that allows for seamless integration of the Stable Diffusion Web-UI. (github.com)