Thin-Plate-Spline-Motion-Model
diff-svc
| Thin-Plate-Spline-Motion-Model | diff-svc | |
|---|---|---|
| 28 | 9 | |
| 3,297 | 2,591 | |
| - | - | |
| 1.9 | 2.8 | |
| 3 months ago | 10 months ago | |
| Jupyter Notebook | Jupyter Notebook | |
| MIT License | GNU Affero General Public License v3.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Thin-Plate-Spline-Motion-Model
-
Okay, that's Ai but how?
Exactly what I was thinking, looks a lot like thin plate spline motion, maybe with some layers/composition for the wings and hair.
- Is it possible to sync a lip and facial expression animation with audio in real time?
- GitHub - yoyo-nb/Thin-Plate-Spline-Motion-Model: [CVPR 2022] Thin-Plate Spline Motion Model for Image Animation. (Question: How do I increase the resolution of the output?)
-
Tools For AI Animation and Filmmaking , Community Rules, ect. (**FAQ**)
First Order Motion Model/Thin Plate Spline (Animate Single images realistically using a driving video) https://github.com/AliaksandrSiarohin/first-order-model (FOMM - Animate still images using driving videos) https://github.com/yoyo-nb/Thin-Plate-Spline-Motion-Model (Thin Plate Spline - Likely just a repost of FOMM but with better documentation and tutorials on YouTube) https://drive.google.com/drive/folders/1PyQJmkdCsAkOYwUyaj_l-l0as-iLDgeH (FOMM/Thin Plate Checkpoints) https://disk.yandex.com/d/lEw8uRm140L_eQ (FOMM/Thin Plate Checkpoints mirror) -------3D ANIMATION--------
-
Help from Community [Development]
GitHub - yoyo-nb/Thin-Plate-Spline-Motion-Model: [CVPR 2022] Thin-Plate Spline Motion Model for Image Animation.
- Elvis & James Blunt singing together - doing Elvis voice synthesis & using Thin-Plate-Spline model for a cheap fast deepfake video to sync
- Does Anyone Know What Tool is used to Make These TikTok Videos?
-
How did he do this?
Probably with using this https://github.com/yoyo-nb/Thin-Plate-Spline-Motion-Model
-
Animate your stable diffusion portraits
Use https://github.com/yoyo-nb/Thin-Plate-Spline-Motion-ModelHuggingface demo: https://huggingface.co/spaces/CVPR/Image-Animation-using-Thin-Plate-Spline-Motion-ModelGoogle Colab: https://colab.research.google.com/drive/1DREfdpnaBhqISg0fuQlAAIwyGVn1loH_?usp=sharing
- SD + thin-plate-spline-motion-model
diff-svc
-
Question: easier way to generate data for voice cloning [Project]
I'm new to voice cloning, but basically, I want to modify the the song Edelweiss from the sound of music and explore making an extended version with christopher plummer's voice (I know he didn't sing the recording in the movie). Anyway, I saw that for Sovits you need 3 hours of voice recordings in 5-15 second chunks to train a diff-SVC model. So I collected youtube recordings of interviews, and found someone on Fiverr who can do the editing, but she's gonna cost $250 to edit the videos into WAV files. Does anyone know an easier way to sort through video for audio clips and automatically cut them up?
-
So what's being used to create these AI music tracks? Such as Biggie rapping new York state of mind?
Most people use RVC, so-vits-svc or diff-svc. I prefer RVC, it seems faster.
- How did the creator deepfake another artist's vocals/tone/inflection into existing songs? Ethicality of this?
- Elvis & James Blunt singing together - doing Elvis voice synthesis & using Thin-Plate-Spline model for a cheap fast deepfake video to sync
-
[D] Is there a way to "clone" or change a voice to sound like another without using TTS models?
You could try https://github.com/svc-develop-team/so-vits-svc/ and https://github.com/prophesier/diff-svc its for singing but could work for dialogue as well.
- What genres can't I produce in FL? (or any other daw out there)
-
Tf2 Heavy sings Ken Ashcorp's "Absolute Territory"
Created with Diff-SVC and a lot of time
-
thoughts on diff svc?
it was released sometime last year on github here
-
Genesis - Congo with Peter Gabriel on lead vocals
All the necessary files are here: https://github.com/prophesier/diff-svc
What are some alternatives?
first-order-model - This repository contains the source code for the paper First Order Motion Model for Image Animation
so-vits-svc - SoftVC VITS Singing Voice Conversion
Wav2Lip - This repository contains the codes of "A Lip Sync Expert Is All You Need for Speech to Lip Generation In the Wild", published at ACM Multimedia 2020. For HD commercial model, please try out Sync Labs
ultimatevocalremovergui - GUI for a Vocal Remover that uses Deep Neural Networks.
DFL-Colab - DeepFaceLab fork which provides IPython Notebook to use DFL with Google Colab
Retrieval-based-Voice-Conversion-WebUI - Easily train a good VC model with voice data <= 10 mins!
SadTalker - [CVPR 2023] SadTalker：Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animation
so-vits-svc-fork - so-vits-svc fork with realtime support, improved interface and more features.
articulated-animation - Code for Motion Representations for Articulated Animation paper
stable-diffusion-webui-depthmap-script - High Resolution Depth Maps for Stable Diffusion WebUI
CVPR2022-DaGAN - Official code for CVPR2022 paper: Depth-Aware Generative Adversarial Network for Talking Head Video Generation
dressing-in-order - (ICCV'21) Official code of "Dressing in Order: Recurrent Person Image Generation for Pose Transfer, Virtual Try-on and Outfit Editing" by Aiyu Cui, Daniel McKee and Svetlana Lazebnik