voca
talking-head-anime-3-demo
voca | talking-head-anime-3-demo | |
---|---|---|
1 | 4 | |
1,106 | 871 | |
- | - | |
0.7 | 0.0 | |
4 months ago | 9 months ago | |
Python | Python | |
- | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
voca
-
Application Overview for NVIDIA Omniverse Audio2Face (AI lip-syncing to audio track)
It's been a thing: https://github.com/TimoBolkart/voca
talking-head-anime-3-demo
-
What would I use to create a chatbot but with an animated face of a man i created with Stable Diffusion - and also do it from my local pc, not any other websites etc. Anyone have any ideas on this?
Talking Head. This is the visual of converting the image into an animated character. This is honestly the hard part. There's vmagicmirror for 3d model vrm/vroid characters. And for anime characters there's talking head anime 3 if you modify it a bit. But other than that there's basically nothing. Some online services can do it for you but not local/offline.
-
100% AI including verse, photo, outpainting, animation, voice, and lip syncing
I'm currently using a modified version of this repo which does face/head posing for anime characters. Works okayish and I can run it around 18fps or so which is decent. Seems to be the best thing available atm. not really accurate lipsync (you have to manually enter mouth position) but I mapped "a" viseme to volume and it works well enough lol.
-
Is there a way to do facial rigs on AI images?
EasyVTuber is based off of Talking Head which has the ability to animate the mouth, eyes, and even the eyebrows with slight head turning and breathing with TrueDepth facial tracking (iPhone): https://github.com/pkhungurn/talking-head-anime-3-demo
-
Can't find root directory, help?
https://github.com/pkhungurn/talking-head-anime-3-demo I keep trying to get the above program to work, but I can't find the the repository's root directory so I can unzip the model files into the data/models folder. How do I find the repository's root directory?
What are some alternatives?
anchorscad - A Python 3D modelling API for generating OpenSCAD source code. This library simplifies the creating of 3D models and contains a suite of completed models including Raspberry Pi cases and other models.
EasyVtuber - tha3, but run 40fps on 3080 with virtural webcam support
curated-list-of-awesome-3D-Morphable-Model-software-and-data - The idea of this list is to collect shared data and algorithms around 3D Morphable Models. You are invited to contribute to this list by adding a pull request. The original list arised from the Dagstuhl seminar on 3D Morphable Models https://www.dagstuhl.de/19102 in March 2019.
squirrel-core - A Python library that enables ML teams to share, load, and transform data in a collaborative, flexible, and efficient way :chestnut:
tree-gen - Procedural generation of tree models in blender
BlenderNeRF - Easy NeRF synthetic dataset creation within Blender
Im2txt - Image captioning ready-to-go inference: show and tell model compatible with Tensorflow r1.9
chatgpt-chan - An implementation of https://www.insider.com/tiktok-programmer-ai-girlfriend-waifu-euthanized-stopped-working-chatgpt-2023-1
AIwaifu - Open-Waifu open-sourced finetunable customizable simpable AI waifu inspired by neuro-sama
Tsuki - Manga uncensoring scripts using DeepCreamPy & HentAI combined with custom scripts
Activeloop Hub - Data Lake for Deep Learning. Build, manage, query, version, & visualize datasets. Stream data real-time to PyTorch/TensorFlow. https://activeloop.ai [Moved to: https://github.com/activeloopai/deeplake]