Video-Motion-Customization
VMC: Video Motion Customization using Temporal Attention Adaption for Text-to-Video Diffusion Models (CVPR 2024) (by HyeonHo99)
MotionDirector
MotionDirector: Motion Customization of Text-to-Video Diffusion Models. (by showlab)
Video-Motion-Customization | MotionDirector | |
---|---|---|
3 | 2 | |
117 | 699 | |
- | 6.6% | |
7.2 | 8.1 | |
about 1 month ago | 3 months ago | |
Python | Python | |
Apache License 2.0 | Apache License 2.0 |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Video-Motion-Customization
Posts with mentions or reviews of Video-Motion-Customization.
We have used some of these posts to build our list of alternatives
and similar projects.
- Code for video motion customization has been released!
-
VMC: Video Motion Customization
Text-to-video diffusion models have advanced video generation significantly. However, customizing these models to generate videos with tailored motions presents a substantial challenge. In specific, they encounter hurdles in (a) accurately reproducing motion from a target video, and (b) creating diverse visual variations. For example, straightforward extensions of static image customization methods to video often lead to intricate entanglements of appearance and motion data. To tackle this, here we present the Video Motion Customization (VMC) framework, a novel one-shot tuning approach crafted to adapt temporal attention layers within video diffusion models. Our approach introduces a novel motion distillation objective using residual vectors between consecutive frames as a motion reference. The diffusion process then preserves low-frequency motion trajectories while mitigating high-frequency motion-unrelated noise in image space. We validate our method against state-of-the-art video generative models across diverse real-world motions and contexts. Our codes, data and the project demo can be found at https://video-motion-customization.github.io/
Code: https://github.com/HyeonHo99/Video-Motion-Customization
MotionDirector
Posts with mentions or reviews of MotionDirector.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-12-10.
- List of Stable Diffusion research softwares that I don't think gotten widespread adoption.
-
MotionDirector releases MotionDirector for sports!
More learned motion concepts will be released. If you like our project, please give us a star ✨ on our Github Repo for the latest update.
What are some alternatives?
When comparing Video-Motion-Customization and MotionDirector you can also consider the following projects:
TokenFlow - Official Pytorch Implementation for "TokenFlow: Consistent Diffusion Features for Consistent Video Editing" presenting "TokenFlow" (ICLR 2024)
DemoFusion - Let us democratise high-resolution generation! (CVPR 2024)
ziplora-pytorch - Implementation of "ZipLoRA: Any Subject in Any Style by Effectively Merging LoRAs"
SEED - Official implementation of SEED-LLaMA (ICLR 2024).
RIVAL - [NeurIPS 2023 Spotlight] Real-World Image Variation by Aligning Diffusion Inversion Chain