[D] Which open source models can replicate wonder dynamics's drag'n'drop cg characters?

• segment-anything

  56 44,026 4.2 Jupyter Notebook

  The repository provides code for running inference with the SegmentAnything Model (SAM), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.

  

Use Segmentation Model (SAM) combined with Inpainting model (E2FGVI) and Xmem to cut out the live action subject.

• E2FGVI

  1 952 1.3 Python

  Official code for "Towards An End-to-End Framework for Flow-Guided Video Inpainting" (CVPR2022)

  

Use Segmentation Model (SAM) combined with Inpainting model (E2FGVI) and Xmem to cut out the live action subject.

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• XMem

  11 1,588 6.3 Python

  [ECCV 2022] XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model

Use Segmentation Model (SAM) combined with Inpainting model (E2FGVI) and Xmem to cut out the live action subject.

• Track-Anything

  16 6,090 8.1 Python

  Track-Anything is a flexible and interactive tool for video object tracking and segmentation, based on Segment Anything, XMem, and E2FGVI.

The Track-Anything tool already implements this

• openpose

  36 29,867 5.1 C++

  OpenPose: Real-time multi-person keypoint detection library for body, face, hands, and foot estimation

  

Perhaps something like OpenPose for pose estimation?

• lama

  17 7,165 5.4 Jupyter Notebook

  🦙 LaMa Image Inpainting, Resolution-robust Large Mask Inpainting with Fourier Convolutions, WACV 2022

  

You may be able to remove the actor with lama. https://github.com/advimman/lama

Suggest a related project