ICON
VIBE
ICON | VIBE | |
---|---|---|
6 | 5 | |
1,542 | 2,802 | |
- | - | |
4.1 | 0.0 | |
5 months ago | about 1 year ago | |
Python | Python | |
GNU General Public License v3.0 or later | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
ICON
- ControlNet fully integrated with Blender using nodes!
- Is there any AI that can compile several pictures of a person into a single, 3d version?
-
[R][P] ICON: Implicit Clothed humans Obtained from Normals + Gradio Web Demo
github: https://github.com/YuliangXiu/ICON
- Show HN: Icon-3D Avatar Creator from 2D Pixels
-
Icon: Towards Large-Scale Avatar Creation from In-the-Wild Pixels
Realistic virtual humans will play a central role in mixed and augmented reality, forming a critical foundation for the Metaverse and supporting remote presence, collaboration, education, and entertainment.
To enable this, new tools are needed to easily create large-scale 3D virtual humans that can be readily animated. However, current methods need either posed 3D scans captured by expensive scanning equipment or 2D images with carefully controlled user poses. Both of them can't scale up easily.
ICON ("Implicit Clothed humans Obtained from Normals") takes a step towards robust 3D clothed human reconstruction from in-the-wild images. This also enables creating animatable avatars directly from video with personalized and natural pose-dependent cloth deformation.
Homepage: https://icon.is.tue.mpg.de/
Github: https://github.com/YuliangXiu/ICON
Google Colab: https://colab.research.google.com/drive/1-AWeWhPvCTBX0KfMtgt...
VIBE
- 3D reconstruction models for human body
-
Any ghetto Mo'Cap solutions?
there are projects like this and similar, that are able to create motion capture from video: https://github.com/KevinLTT/video2bvh or https://github.com/mkocabas/VIBE
- My experience using VIBE ( free motion extraction tool for animation )
- Free deep learning tool for extracting animation from videos (link in post)
-
Markerless Motion Capture - Turning Videos into 3D Animations
Another Edit: Here's another one that supports FBX export out of the box: https://github.com/mkocabas/VIBE
What are some alternatives?
lightweight-human-pose-estimation.pytorch - Fast and accurate human pose estimation in PyTorch. Contains implementation of "Real-time 2D Multi-Person Pose Estimation on CPU: Lightweight OpenPose" paper.
video2bvh - Extracts human motion in video and save it as bvh mocap file.
ECON - [CVPR'23, Highlight] ECON: Explicit Clothed humans Optimized via Normal integration
frankmocap - A Strong and Easy-to-use Single View 3D Hand+Body Pose Estimator
dream-textures - Stable Diffusion built-in to Blender
openpose - OpenPose: Real-time multi-person keypoint detection library for body, face, hands, and foot estimation
AlphaPose - Real-Time and Accurate Full-Body Multi-Person Pose Estimation&Tracking System
mediapipe - Cross-platform, customizable ML solutions for live and streaming media.
text2cinemagraph - Text2Cinemagraph: Text-Guided Synthesis of Eulerian Cinemagraphs [SIGGRAPH ASIA 2023]
aistplusplus_api - API to support AIST++ Dataset: https://google.github.io/aistplusplus_dataset
smplx - SMPL-X