Top 7 image-animation Open-Source Projects

• first-order-model

  53 14,206 3.9 Jupyter Notebook

  This repository contains the source code for the paper First Order Motion Model for Image Animation

Project mention: Is it possible to sync a lip and facial expression animation with audio in real time? | /r/node | 2023-05-29

• Thin-Plate-Spline-Motion-Model

  28 3,297 1.9 Jupyter Notebook

  [CVPR 2022] Thin-Plate Spline Motion Model for Image Animation.

Project mention: Okay, that's Ai but how? | /r/StableDiffusion | 2023-07-12

Exactly what I was thinking, looks a lot like thin plate spline motion, maybe with some layers/composition for the wings and hair.

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• articulated-animation

  4 1,187 3.7 Jupyter Notebook

  Code for Motion Representations for Articulated Animation paper

  

• awesome-talking-head-generation

  2 1,124 6.9

Project mention: Ask HN: How does Heygen AI video generation works? | news.ycombinator.com | 2023-11-19

I assume it's a SOTA version of "talking head generation" or something related.

https://paperswithcode.com/task/talking-head-generation

https://github.com/harlanhong/awesome-talking-head-generatio...

• sd-wav2lip-uhq

  1 1,041 7.8 Python

  Wav2Lip UHQ extension for Automatic1111

Project mention: Time Travel Scene - Gen-2, ElevenLabs, Wav2Lip | /r/aivideo | 2023-08-10

Hi, Great job, If you need to remove the wav2lip blur, you can use : https://github.com/numz/sd-wav2lip-uhq

• CVPR2022-DaGAN

  5 937 5.8 Python

  Official code for CVPR2022 paper: Depth-Aware Generative Adversarial Network for Talking Head Video Generation

Project mention: DaGAN++: Depth-Aware Generative Adversarial Network for Talking Head Video Generation | /r/BotNewsPreprints | 2023-05-11

Predominant techniques on talking head generation largely depend on 2D information, including facial appearances and motions from input face images. Nevertheless, dense 3D facial geometry, such as pixel-wise depth, plays a critical role in constructing accurate 3D facial structures and suppressing complex background noises for generation. However, dense 3D annotations for facial videos is prohibitively costly to obtain. In this work, firstly, we present a novel self-supervised method for learning dense 3D facial geometry (ie, depth) from face videos, without requiring camera parameters and 3D geometry annotations in training. We further propose a strategy to learn pixel-level uncertainties to perceive more reliable rigid-motion pixels for geometry learning. Secondly, we design an effective geometry-guided facial keypoint estimation module, providing accurate keypoints for generating motion fields. Lastly, we develop a 3D-aware cross-modal (ie, appearance and depth) attention mechanism, which can be applied to each generation layer, to capture facial geometries in a coarse-to-fine manner. Extensive experiments are conducted on three challenging benchmarks (ie, VoxCeleb1, VoxCeleb2, and HDTF). The results demonstrate that our proposed framework can generate highly realistic-looking reenacted talking videos, with new state-of-the-art performances established on these benchmarks. The codes and trained models are publicly available on the GitHub project page at https://github.com/harlanhong/CVPR2022-DaGAN

• wunjo.wladradchenko.ru

  6 706 9.5 Python

  Wunjo AI: Synthesize & clone voices in English, Russian & Chinese, real-time speech recognition, deepfake face & lips animation, face swap with one photo, change video by text prompts, segmentation, and retouching. Open-source, local & free.

Project mention: Check out Wunjo AI – open-source AI Toolkit | news.ycombinator.com | 2024-01-16

AI Retouch Tool & Segmentation Mask

GitHub Stars Needed!

We're at 499 stars on GitHub, just 13 away from a cool milestone! If you like what you see, I'd appreciate your support. Check it out and drop a star if you find it interesting.

GitHub Repository: https://github.com/wladradchenko/wunjo.wladradchenko.ru

Thanks a bunch for your time and support!

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

image-animation related posts

• Check out Wunjo AI – open-source AI Toolkit

  2 projects | news.ycombinator.com | 16 Jan 2024

• Ask HN: How does Heygen AI video generation works?

  2 projects | news.ycombinator.com | 19 Nov 2023

• Update Wunjo AI:Voice cloning from music, remove text from video, more deepfakes

  2 projects | news.ycombinator.com | 16 Nov 2023

• Voice Cloning, Face Swap, Video Object Removal: Open-Source Wunjo AI on Python

  1 project | news.ycombinator.com | 10 Sep 2023

• Okay, that's Ai but how?

  2 projects | /r/StableDiffusion | 12 Jul 2023

• Is it possible to sync a lip and facial expression animation with audio in real time?

  4 projects | /r/node | 29 May 2023

• GitHub - yoyo-nb/Thin-Plate-Spline-Motion-Model: [CVPR 2022] Thin-Plate Spline Motion Model for Image Animation. (Question: How do I increase the resolution of the output?)

  1 project | /r/github | 20 May 2023
• A note from our sponsor - SaaSHub
  www.saashub.com | 6 May 2024

  SaaSHub helps you find the best software and product alternatives Learn more →

Index

Sponsored

SaaSHub - Software Alternatives and Reviews

SaaSHub helps you find the best software and product alternatives

www.saashub.com