Top 9 talking-head Open-Source Projects

• SadTalker

  16 10,611 5.9 Python

  [CVPR 2023] SadTalker：Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animation

  

Project mention: Can some expert analyze a github repo and tell us if it's really safe or not? | /r/cybersecurity | 2023-12-07

• AudioGPT

  4 9,796 3.7 Python

  AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Head

  

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• Thin-Plate-Spline-Motion-Model

  28 3,320 1.9 Jupyter Notebook

  [CVPR 2022] Thin-Plate Spline Motion Model for Image Animation.

Project mention: Okay, that's Ai but how? | /r/StableDiffusion | 2023-07-12

Exactly what I was thinking, looks a lot like thin plate spline motion, maybe with some layers/composition for the wings and hair.

• GeneFace

  1 2,355 6.7 Python

  GeneFace: Generalized and High-Fidelity 3D Talking Face Synthesis; ICLR 2023; Official code

• awesome-talking-head-generation

  2 1,153 6.8

Project mention: Ask HN: How does Heygen AI video generation works? | news.ycombinator.com | 2023-11-19

I assume it's a SOTA version of "talking head generation" or something related.

https://paperswithcode.com/task/talking-head-generation

https://github.com/harlanhong/awesome-talking-head-generatio...

• sd-wav2lip-uhq

  1 1,070 7.8 Python

  Wav2Lip UHQ extension for Automatic1111

Project mention: Time Travel Scene - Gen-2, ElevenLabs, Wav2Lip | /r/aivideo | 2023-08-10

Hi, Great job, If you need to remove the wav2lip blur, you can use : https://github.com/numz/sd-wav2lip-uhq

• CVPR2022-DaGAN

  5 939 5.8 Python

  Official code for CVPR2022 paper: Depth-Aware Generative Adversarial Network for Talking Head Video Generation

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

• wunjo.wladradchenko.ru

  6 719 9.5 Python

  Wunjo AI: Synthesize & clone voices in English, Russian & Chinese, real-time speech recognition, deepfake face & lips animation, face swap with one photo, change video by text prompts, segmentation, and retouching. Open-source, local & free.

Project mention: Check out Wunjo AI – open-source AI Toolkit | news.ycombinator.com | 2024-01-16

AI Retouch Tool & Segmentation Mask

GitHub Stars Needed!

We're at 499 stars on GitHub, just 13 away from a cool milestone! If you like what you see, I'd appreciate your support. Check it out and drop a star if you find it interesting.

GitHub Repository: https://github.com/wladradchenko/wunjo.wladradchenko.ru

Thanks a bunch for your time and support!

• Text2Video

  1 409 3.8 Python

  ICASSP 2022: "Text2Video: text-driven talking-head video synthesis with phonetic dictionary".

talking-head related posts

• Does the sad talker repo contain a virus/trojan yes or not?

  1 project | /r/StableDiffusion | 7 Dec 2023

• Ask HN: How does Heygen AI video generation works?

  2 projects | news.ycombinator.com | 19 Nov 2023

• Lip Sync API Service?

  1 project | /r/LocalLLaMA | 17 Sep 2023

• SD + Augmented Reality

  2 projects | /r/StableDiffusion | 18 Aug 2023

• Are there any plugins that allow you to lip-sync/move faces?

  1 project | /r/StableDiffusion | 4 Jul 2023

• Judy Collins animation generated with HeyGen

  1 project | /r/artificial | 4 Jun 2023

• [D] Better alternatives to Wav2Lip?

  1 project | /r/MachineLearning | 1 Jun 2023
• A note from our sponsor - InfluxDB
  www.influxdata.com | 15 May 2024

  Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →

Index

Sponsored

SaaSHub - Software Alternatives and Reviews

SaaSHub helps you find the best software and product alternatives

www.saashub.com