AnimateDiff
Thin-Plate-Spline-Motion-Model
AnimateDiff | Thin-Plate-Spline-Motion-Model | |
---|---|---|
9 | 28 | |
9,417 | 3,351 | |
- | - | |
7.7 | 1.9 | |
5 days ago | 4 months ago | |
Python | Jupyter Notebook | |
Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
AnimateDiff
- Animediff – turn images into videos by AI
- Going to lose my mind at this point with this problem
-
[P] Do you want to join a motley crew who are scaling/retraining AnimateDiff for open source? AD trainer code just released!
POM from Banodoco.ai/Steerable Motion here. A bunch of closed-source companies are building on top of Animatediff - for example, Kaiber.ai launched an impressive image2video tool - and others are working towards scaling it.
-
AnimateDiff is pretty cool to mess around with
No clue if shorts embed properly. If not I can always post the video file when I’m at my computer later today GitHub: https://github.com/guoyww/AnimateDiff
-
Future of AI Video generation. PIKA LABS.
Isn't this just AnimateDiff?
- Okay, that's Ai but how?
-
AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning
GitHub repo has been updated: guoyww/AnimateDiff: Official implementation of AnimateDiff. (github.com)
- AnimateDiff
Thin-Plate-Spline-Motion-Model
-
Okay, that's Ai but how?
Exactly what I was thinking, looks a lot like thin plate spline motion, maybe with some layers/composition for the wings and hair.
- Is it possible to sync a lip and facial expression animation with audio in real time?
- GitHub - yoyo-nb/Thin-Plate-Spline-Motion-Model: [CVPR 2022] Thin-Plate Spline Motion Model for Image Animation. (Question: How do I increase the resolution of the output?)
-
Tools For AI Animation and Filmmaking , Community Rules, ect. (**FAQ**)
First Order Motion Model/Thin Plate Spline (Animate Single images realistically using a driving video) https://github.com/AliaksandrSiarohin/first-order-model (FOMM - Animate still images using driving videos) https://github.com/yoyo-nb/Thin-Plate-Spline-Motion-Model (Thin Plate Spline - Likely just a repost of FOMM but with better documentation and tutorials on YouTube) https://drive.google.com/drive/folders/1PyQJmkdCsAkOYwUyaj_l-l0as-iLDgeH (FOMM/Thin Plate Checkpoints) https://disk.yandex.com/d/lEw8uRm140L_eQ (FOMM/Thin Plate Checkpoints mirror) -------3D ANIMATION--------
-
Help from Community [Development]
GitHub - yoyo-nb/Thin-Plate-Spline-Motion-Model: [CVPR 2022] Thin-Plate Spline Motion Model for Image Animation.
- Elvis & James Blunt singing together - doing Elvis voice synthesis & using Thin-Plate-Spline model for a cheap fast deepfake video to sync
- Does Anyone Know What Tool is used to Make These TikTok Videos?
-
How did he do this?
Probably with using this https://github.com/yoyo-nb/Thin-Plate-Spline-Motion-Model
-
Animate your stable diffusion portraits
Use https://github.com/yoyo-nb/Thin-Plate-Spline-Motion-ModelHuggingface demo: https://huggingface.co/spaces/CVPR/Image-Animation-using-Thin-Plate-Spline-Motion-ModelGoogle Colab: https://colab.research.google.com/drive/1DREfdpnaBhqISg0fuQlAAIwyGVn1loH_?usp=sharing
- SD + thin-plate-spline-motion-model
What are some alternatives?
SD-CN-Animation - This script allows to automate video stylization task using StableDiffusion and ControlNet.
first-order-model - This repository contains the source code for the paper First Order Motion Model for Image Animation
AnimateDiff - Official implementation of AnimateDiff.
Wav2Lip - This repository contains the codes of "A Lip Sync Expert Is All You Need for Speech to Lip Generation In the Wild", published at ACM Multimedia 2020. For HD commercial model, please try out Sync Labs
frame-interpolation - FILM: Frame Interpolation for Large Motion, In ECCV 2022.
DFL-Colab - DeepFaceLab fork which provides IPython Notebook to use DFL with Google Colab
SadTalker - [CVPR 2023] SadTalker:Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animation
articulated-animation - Code for Motion Representations for Articulated Animation paper
stable-diffusion-webui-depthmap-script - High Resolution Depth Maps for Stable Diffusion WebUI
CVPR2022-DaGAN - Official code for CVPR2022 paper: Depth-Aware Generative Adversarial Network for Talking Head Video Generation
dressing-in-order - (ICCV'21) Official code of "Dressing in Order: Recurrent Person Image Generation for Pose Transfer, Virtual Try-on and Outfit Editing" by Aiyu Cui, Daniel McKee and Svetlana Lazebnik
vid2vid - Pytorch implementation of our method for high-resolution (e.g. 2048x1024) photorealistic video-to-video translation.