MotioNet
VIBE
| MotioNet | VIBE | |
|---|---|---|
| 1 | 5 | |
| 551 | 2,802 | |
| - | - | |
| 0.0 | 0.0 | |
| about 2 years ago | about 1 year ago | |
| Python | Python | |
| BSD 2-clause "Simplified" License | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
MotioNet
-
Photorealistic Monocular 3D Reconstruction of Humans Wearing Clothing
They could be a great application for niches, though. Prototyping 3d games or movies can be helped greatly by such techniques.
If you can take a photo (effort required: seconds) and turn it into a textures low- to mid-poly model within seconds, that's a huge time saver right there.
Combined with other techniques [1], [2] this could indeed present a viable business model - again for certain niches. It's the same old routine: identify potential, present solution, profit (if only for a limited time). On its own this might not look too useful/impressive, but I'm certain there's people out there who could already benefit greatly from this work.
It's not always about "the next big thing" or "turning an entire industry on its head". I could see this work its way into various products without much fanfare and gazillion dollar valuations.
[1] https://github.com/Shimingyi/MotioNet
[2] https://deepai.org/publication/end-to-end-learning-for-3d-fa...
VIBE
- 3D reconstruction models for human body
-
Any ghetto Mo'Cap solutions?
there are projects like this and similar, that are able to create motion capture from video: https://github.com/KevinLTT/video2bvh or https://github.com/mkocabas/VIBE
- My experience using VIBE ( free motion extraction tool for animation )
- Free deep learning tool for extracting animation from videos (link in post)
-
Markerless Motion Capture - Turning Videos into 3D Animations
Another Edit: Here's another one that supports FBX export out of the box: https://github.com/mkocabas/VIBE
What are some alternatives?
Meshroom - 3D Reconstruction Software
video2bvh - Extracts human motion in video and save it as bvh mocap file.
MotionBERT - [ICCV 2023] PyTorch Implementation of "MotionBERT: A Unified Perspective on Learning Human Motion Representations"
frankmocap - A Strong and Easy-to-use Single View 3D Hand+Body Pose Estimator
deep-motion-editing - An end-to-end library for editing and rendering motion of 3D characters with deep learning [SIGGRAPH 2020]
openpose - OpenPose: Real-time multi-person keypoint detection library for body, face, hands, and foot estimation
awesome-virtual-try-on - A curated list of awesome research papers, projects, code, dataset, workshops etc. related to virtual try-on.
mediapipe - Cross-platform, customizable ML solutions for live and streaming media.
duckduckgo-locales - Translation files for <a href="https://duckduckgo.com"> </a>
AlphaPose - Real-Time and Accurate Full-Body Multi-Person Pose Estimation&Tracking System
smplx - SMPL-X
SMPL - NumPy, TensorFlow and PyTorch implementation of human body SMPL model and infant body SMIL model.