stable-diffusion-videos VS sd-dynamic-prompts

Main Code: https://github.com/nateraw/stable-diffusion-videos/

So I've continued to experiment with how many papers I can fit into a single pipe and have them play nicely together. The images below were created by combining the panorama code from omerbt/MultiDiffusion with the ideas from albarji/mixture-of-diffusers. Also turns out nateraw/stable-diffusion-videos can be seen as a special case of a panorama (in latent space rather than prompt space).

https://huggingface.co/spaces/tomg-group-umd/pez-dispenser https://huggingface.co/spaces/AIML-TUDA/safe-stable-diffusion https://huggingface.co/spaces/AIML-TUDA/semantic-diffusion https://github.com/nateraw/stable-diffusion-videos

The goal is to make a (short) video out of a given first and last frame. It is similar to what this guy does (https://github.com/nateraw/stable-diffusion-videos (7sec example video half way down page)). But instead of starting and ending with a prompt, I want to start and end with 2 different frames.

Hey Y'all! We've been working on a tool that extends Nate Raw's Stable Diffusion Videos repo and makes it as easy as possible to use for artists and are having a competition this week to stress test the beta and see who can use it to make the most compelling short video (40 seconds max)

Of course! There might be a better process but mainly used: 1.) Nate Raw's repo for morphing between prompts https://github.com/nateraw/stable-diffusion-videos 2.) Google FILM interpolation to smooth out transitions https://github.com/google-research/frame-interpolation

There are directions in the readme and an example script.

This does exactly that - https://github.com/nateraw/stable-diffusion-videos

I found some of the images I remember from the article I'm trying to find, buried deep in the StylePile Extension , but sadly not the article itself. The Wildcards Directory Extension looks promising as well, although it seems only tangentially related to what I'm looking for.

While not really relevant to the issue I am trying to use a program to build wildcards to use with sd-dynamic-prompts. That is why the code contains a few weird things in how it outputs the files and why it restricts certain characters on input.

wildcards already done https://github.com/adieyal/sd-dynamic-prompts/blob/main/collections/nsp/nsp/nationality.txt

Body types is on my to-do list if I can make it work. As for custom categories, probably not. Honestly if that's what you want you should use a straightforward wildcard extension like Dynamic Prompts. Try it, it's fantastic.

First step: install the dynamic prompt extension (you may like some of its extra features as they fall directly in the type of work you are doing) or the barebones Wildcard extension that was initially released by A1111 himself.

This is an experimental attempt in order to avoid "same face"/copypaste effect of having multiple subjects. It's simply using adetailer and dynamic prompt extension to create a group people with different clothing/expressions. The prompt in both txt2img and adetailer can be changed according to what the project need.

https://github.com/adieyal/sd-dynamic-prompts let you add random (or controlled) info to your prompt