Video-Motion-Customization

VMC: Video Motion Customization using Temporal Attention Adaption for Text-to-Video Diffusion Models (CVPR 2024) (by HyeonHo99)

Video-Motion-Customization Alternatives

Similar projects and alternatives to Video-Motion-Customization based on common topics and language

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better Video-Motion-Customization alternative or higher similarity.

Video-Motion-Customization reviews and mentions

Posts with mentions or reviews of Video-Motion-Customization. We have used some of these posts to build our list of alternatives and similar projects.
  • Code for video motion customization has been released!
    1 project | /r/StableDiffusion | 8 Dec 2023
  • VMC: Video Motion Customization
    1 project | /r/StableDiffusion | 7 Dec 2023
    Text-to-video diffusion models have advanced video generation significantly. However, customizing these models to generate videos with tailored motions presents a substantial challenge. In specific, they encounter hurdles in (a) accurately reproducing motion from a target video, and (b) creating diverse visual variations. For example, straightforward extensions of static image customization methods to video often lead to intricate entanglements of appearance and motion data. To tackle this, here we present the Video Motion Customization (VMC) framework, a novel one-shot tuning approach crafted to adapt temporal attention layers within video diffusion models. Our approach introduces a novel motion distillation objective using residual vectors between consecutive frames as a motion reference. The diffusion process then preserves low-frequency motion trajectories while mitigating high-frequency motion-unrelated noise in image space. We validate our method against state-of-the-art video generative models across diverse real-world motions and contexts. Our codes, data and the project demo can be found at https://video-motion-customization.github.io/
    1 project | /r/StableDiffusion | 7 Dec 2023
    Code: https://github.com/HyeonHo99/Video-Motion-Customization
  • A note from our sponsor - SaaSHub
    www.saashub.com | 27 Apr 2024
    SaaSHub helps you find the best software and product alternatives Learn more →

Stats

Basic Video-Motion-Customization repo stats
3
116
7.2
30 days ago

HyeonHo99/Video-Motion-Customization is an open source project licensed under Apache License 2.0 which is an OSI approved license.

The primary programming language of Video-Motion-Customization is Python.


Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com