pytorch-AdaIN VS PeopleSansPeople

Thanks for the comment. I am using the 3d views directly. I tried to use some form of style transfer (https://github.com/naoto0804/pytorch-AdaIN) from real to synth data, but the result was'nt that appealing, so I moved on. I guess that it could be due to the fact that generally the real data that I have has low resolution (120x40 tipically). I ll have a check on the model that you suggested though, seems interesting.

Also, check this Unity repo out

I was trying to train a model which goes on top of one of the pose estimation models(posenet, movenet, mediapipe) which detects the action performed(waving, swipe right, etc), and I was planning on generating synthetic data for it. I saw that there's a project for unity PeopleSansPeople, but it's not right to train a model for action recognition. I would like something that either simulates a human doing a simple action, to which I would be able to add randomness to it. I was thinking to either use Unity or maybe write something that would model the human keypoints(the output of pose estimation) and simulate them.. I am wondering if there already exists something that you guys might know about??

Source code: https://github.com/Unity-Technologies/PeopleSansPeople

Webpage: https://unity-technologies.github.io/PeopleSansPeople/ Paper: https://arxiv.org/abs/2112.09290 Source code: https://github.com/Unity-Technologies/PeopleSansPeople Papers with code: https://paperswithcode.com/paper/peoplesanspeople-a-synthetic-data-generator                                    https://paperswithcode.com/dataset/peoplesanspeople Demo video: https://youtu.be/mQ_DUdB70dc Summary: PeopleSansPeople is a human-centric data generator provided by Unity Technologies that contains highly-parametric and simulation-ready 3D human assets, parameterized lighting and camera system, parameterized environment generators, and fully-manipulable and extensible domain randomizers. PeopleSansPeople can generate RGB images with sub-pixel-perfect 2D/3D bounding box, COCO-compliant human keypoints, and semantic/instance segmentation masks in JSON annotation files. All packaged in macOS and Linux executable binaries capable of generating 1M+ datasets. In addition we release a template Unity environment for lowering the barrier of entry and getting you started with creating your own highly-parameterized human-centric synth data generator. We affectionately named our synthetic data generator PeopleSansPeople, as it is a data generator aimed at human-centric computer vision without using human data which bears serious privacy, safety, ethical, bias, and legal concerns. Benchmarks: The domain randomization we used for our benchmarks are naïve, brute-forced sweeps through the pre-chosen range of parameters; as such we end up generating psychedelic-looking scenes, which turned out to train more performant models for human-centric computer vision.Using PeopleSansPeople we benchmarked a Detectron2 Keypoint R-CNN variant. Results indicate synthetic pre-training with our data outperforms results of training on real data alone or pre-training with ImageNet, both in limited and abundant data regimes.We envisage that this freely-available data generator should enable a wide range of research into the emerging field of simulation to real transfer learning in the critical area of human-centric computer vision.