stable-diffusion-videos
sd-dynamic-prompts
stable-diffusion-videos | sd-dynamic-prompts | |
---|---|---|
17 | 118 | |
4,234 | 1,899 | |
- | - | |
2.0 | 7.9 | |
about 1 year ago | 13 days ago | |
Python | Python | |
Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
stable-diffusion-videos
- How to create it?
-
Stable Diffusion Text-to-Video WebUI
Main Code: https://github.com/nateraw/stable-diffusion-videos/
-
Messing with the denoising loop can allow you to reach new places in latent space. Over 8+ different research papers/Auto1111 extension ideas in a single pipe. Load once and do lots of different things (SD 2.1 or 1.5)
So I've continued to experiment with how many papers I can fit into a single pipe and have them play nicely together. The images below were created by combining the panorama code from omerbt/MultiDiffusion with the ideas from albarji/mixture-of-diffusers. Also turns out nateraw/stable-diffusion-videos can be seen as a special case of a panorama (in latent space rather than prompt space).
-
Comparison of new UniPC sampler method added to Automatic1111
https://huggingface.co/spaces/tomg-group-umd/pez-dispenser https://huggingface.co/spaces/AIML-TUDA/safe-stable-diffusion https://huggingface.co/spaces/AIML-TUDA/semantic-diffusion https://github.com/nateraw/stable-diffusion-videos
-
Start Frame -> Stable Diffusion + Linear Interpolation -> End Frame
The goal is to make a (short) video out of a given first and last frame. It is similar to what this guy does (https://github.com/nateraw/stable-diffusion-videos (7sec example video half way down page)). But instead of starting and ending with a prompt, I want to start and end with 2 different frames.
-
Stable Diffusion Videos Easy-to-Use Playground & Competition This Week
Hey Y'all! We've been working on a tool that extends Nate Raw's Stable Diffusion Videos repo and makes it as easy as possible to use for artists and are having a competition this week to stress test the beta and see who can use it to make the most compelling short video (40 seconds max)
- Create videos with Stablediffusion. Saw this project and thought someone here might like it.
-
Tried to pull off an ultra smooth video where you don't realize the scenes are changing until after-the-fact so I could make an 8hr background video that won't give seizures
Of course! There might be a better process but mainly used: 1.) Nate Raw's repo for morphing between prompts https://github.com/nateraw/stable-diffusion-videos 2.) Google FILM interpolation to smooth out transitions https://github.com/google-research/frame-interpolation
-
[video] Packed underground rave in North Korea with dj ill kim headlining
There are directions in the readme and an example script.
-
Short interpolation animation between several frames?
This does exactly that - https://github.com/nateraw/stable-diffusion-videos
sd-dynamic-prompts
-
Prompt Syntax Language--I know I saw it, but where?
I found some of the images I remember from the article I'm trying to find, buried deep in the StylePile Extension , but sadly not the article itself. The Wildcards Directory Extension looks promising as well, although it seems only tangentially related to what I'm looking for.
-
Can't get random combinations to work
While not really relevant to the issue I am trying to use a program to build wildcards to use with sd-dynamic-prompts. That is why the code contains a few weird things in how it outputs the files and why it restricts certain characters on input.
-
SDXL black people look amazing.
wildcards already done https://github.com/adieyal/sd-dynamic-prompts/blob/main/collections/nsp/nsp/nationality.txt
- Is there a way to get a random output of locations/backgrounds?
- Random or Logical operators in text prompt syntax?
-
Nearly Unlimited Female Faces
Body types is on my to-do list if I can make it work. As for custom categories, probably not. Honestly if that's what you want you should use a straightforward wildcard extension like Dynamic Prompts. Try it, it's fantastic.
-
Need help with ideas
First step: install the dynamic prompt extension (you may like some of its extra features as they fall directly in the type of work you are doing) or the barebones Wildcard extension that was initially released by A1111 himself.
-
Creating a randomized crowd with various expression through txt2img with adetailer + dynamic prompt extension
This is an experimental attempt in order to avoid "same face"/copypaste effect of having multiple subjects. It's simply using adetailer and dynamic prompt extension to create a group people with different clothing/expressions. The prompt in both txt2img and adetailer can be changed according to what the project need.
-
How do I create more varied images, in one batch?
https://github.com/adieyal/sd-dynamic-prompts let you add random (or controlled) info to your prompt
- What are some must-have/fun extensions or modules?
What are some alternatives?
frame-interpolation - FILM: Frame Interpolation for Large Motion, In ECCV 2022.
stable-diffusion-webui-wildcards - Wildcards
dain-ncnn-vulkan - DAIN, Depth-Aware Video Frame Interpolation implemented with ncnn library
ComfyUI - The most powerful and modular stable diffusion GUI, api and backend with a graph/nodes interface.
stable-diffusion-webui - Stable Diffusion web UI [Moved to: https://github.com/Sygil-Dev/sygil-webui]
a1111-sd-webui-tagcomplete - Booru style tag autocompletion for AUTOMATIC1111's Stable Diffusion web UI
stable-karlo - Upscaling Karlo text-to-image generation using Stable Diffusion v2.
unprompted - Templating language written for Stable Diffusion workflows. Available as an extension for the Automatic1111 WebUI.
stable-diffusion-tensorflow-IntelMetal - Stable Diffusion in TensorFlow / Keras, Designed for Apple Metal on Intel. Forked from @divamgupta's work [Moved to: https://github.com/soten355/MetalDiffusion]
sd-webui-regional-prompter - set prompt to divided region
Video-Diffusion-WebUI - Video Diffusion WebUI: Text2Video + Image2Video + Video2Video WebUI
adetailer - Auto detecting, masking and inpainting with detection model.