SadTalker
Torch-Pruning
| SadTalker | Torch-Pruning | |
|---|---|---|
| 16 | 2 | |
| 10,611 | 2,340 | |
| 9.0% | - | |
| 5.9 | 9.4 | |
| 5 days ago | 17 days ago | |
| Python | Python | |
| GNU General Public License v3.0 or later | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
SadTalker
- Can some expert analyze a github repo and tell us if it's really safe or not?
-
Does the sad talker repo contain a virus/trojan yes or not?
Trojan detected when uncompressing facevid2vid_00189-model.pth · Issue #75 · OpenTalker/SadTalker (github.com)
-
Lip Sync API Service?
I am using SadTalker to create a lipsync of a still image with an audio file. The still image is from Stable Diffusion and the audio is from ChatGPT and then AWS Polly for the voice synthesis. My problem is that even though I like the results it takes one and a half minutes to generate this video. If I use the enhancer it is more like five minutes. I am using a A10 NVIDIA GPU.
-
SD + Augmented Reality
Stable Diffusion A1111 + Sadtalker Extension - https://github.com/OpenTalker/SadTalker.git
- Are there any plugins that allow you to lip-sync/move faces?
-
Judy Collins animation generated with HeyGen
Isn't this just SadTalker?
- [D] Better alternatives to Wav2Lip?
-
😋 AGI (bark 🐶) Smart waitress 🎙️
🎥 OpenTalker/SadTalker
- I just got into SD, and discovering all the different extensions has been a lot of fun. Yesterday, I stumbled across SadTalker...audio source in comments.
- Testing a new prompt-speech to video extension for A1111 stable-diffusion-webui from one single image
Torch-Pruning
-
[P] Help: I want to compress EfficientnetV2 using pruning.
I also tried structured pruning from https://github.com/VainF/Torch-Pruning, as they report EfficientNetV2 to be "prunable", but got much worse results. However, the advantage of this approach is that it keeps the model dense, and you can get a real speed-up with common GPUs, while unstructured pruning sparsifies the model and you need hardware that can exploit such sparsity.
-
[D] What is your go-to implementation for structured pruning?
I'm currently using this repo and I find it very intuitive: https://github.com/VainF/Torch-Pruning. Not sure if it fits your needs, but check it out :)
What are some alternatives?
bark - 🔊 Text-Prompted Generative Audio Model
efficient-gnns - Code and resources on scalable and efficient Graph Neural Networks
sd-wav2lip-uhq - Wav2Lip UHQ extension for Automatic1111
only_train_once - OTOv1-v3, NeurIPS, ICLR, TMLR, DNN Training, Compression, Structured Pruning, Erasing Operators, CNN, Diffusion, LLM
GeneFace - GeneFace: Generalized and High-Fidelity 3D Talking Face Synthesis; ICLR 2023; Official code
nni - An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.
Thin-Plate-Spline-Motion-Model - [CVPR 2022] Thin-Plate Spline Motion Model for Image Animation.
UPop - [ICML 2023] UPop: Unified and Progressive Pruning for Compressing Vision-Language Transformers.
openscene - [CVPR'23] OpenScene: 3D Scene Understanding with Open Vocabularies
Painter - Painter & SegGPT Series: Vision Foundation Models from BAAI