RVD
Diffusion Probabilistic Modeling for Video Generation (by buggyyang)
latentblending
Create butter-smooth transitions between prompts, powered by stable diffusion (by lunarring)
| RVD | latentblending | |
|---|---|---|
| 1 | 17 | |
| 54 | 324 | |
| - | 3.1% | |
| 10.0 | 8.7 | |
| over 1 year ago | 2 months ago | |
| Python | Python | |
| - | BSD 3-clause "New" or "Revised" License |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
RVD
Posts with mentions or reviews of RVD.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-03-01.
-
Next frame prediction with ControlNet
Some resources I found: rvd, Next_Frame_Prediction, Next-Frame-Prediction
latentblending
Posts with mentions or reviews of latentblending.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-12-10.
- Introducing Steerable Motion v. 1.0, a ComfyUI custom node for steering videos using batches of images
- Smooth Diffusion: Crafting Smooth Latent Spaces in Diffusion Models
-
A quick visual guide to what's actually happening when you generate an image with Stable Diffusion
So it ought to be pretty easy to implement latent blending on source and target images which were not generated by SD?
-
Next frame prediction with ControlNet
latent blending: https://github.com/lunarring/latentblending This one has a lot of potential, since it can be used to transition from one prompt to the next. It interpolates between the prompst and also the image latents themselves.
-
Bridge Remodeling Takes a Trippy Turn
you can stay tuned also on twitter https://twitter.com/j_stelzer or github https://github.com/lunarring/latentblending/
-
Mindfuck animation
yip, long interpolation using experimental version of latent blending (https://github.com/lunarring/latentblending/). you will be able to do this yourself very soon with a nice gradio UI.
-
Music video I made using Stable Diffusion + the "latent blending" technique
Github: https://github.com/lunarring/latentblending/
- So is SD ever going to get a 'blend' function like midjourney pulled off, or is mixing images like that never going to happen...
-
Fine-tuned a multi-subject model using EveryDream then created some videos morphing between the subjects using latent blending
Generated some images using that model and picked ones that had similar composition to create the videos using latent blending: https://github.com/lunarring/latentblending/
-
Auto1111 Fork with pix2pix
Latent blending is a amazing, and produces effects quite different to the available extensions. https://github.com/lunarring/latentblending
What are some alternatives?
When comparing RVD and latentblending you can also consider the following projects:
stable-diffusion-webui-pix2pix - Stable Diffusion web UI
course22p2 - course.fast.ai 2022 part 2
StableTuner - Finetuning SD in style.
instruct-pix2pix
Next_Frame_Prediction - Predicts the next frame of a series of gifs.
ControlNet - Let us control diffusion models!
Steerable-Motion - A ComfyUI node for driving videos using batches of images.
prompt-to-prompt