-
Summary: I've implemented real-time mono-webcam full body tracking, but I'm having trouble sending this data to vrchat. This function was actually implemented on Unity, and socket communication was used in Unity. Is there a socket communication method that works with udonsharp or vrchat? Here are the solutions I reviewed. https://github.com/Xytabich/UNet I think Unet is very similar to the solution I was looking for, but the connection ID uses the person object that entered the world. I want to receive data from outside.
-
CodeRabbit
CodeRabbit: AI Code Reviews for Developers. Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.
-
https://github.com/fa-m/midi-websocket MIDI websockets pose a fundamental question to me. This solution is difficult to analyze and emphasizes the importance of security.
-
This only works for your own avatar though. If you want to make something that is displayed in a single world you can look into ShaderMotion, which is a system to bring humanoid poses into VRC worlds. The data is sent via a video feed (as blinking pixels) and a shader then reads out those pixels and "animates" the model accordingly.
-
MotionBERT
[ICCV 2023] PyTorch Implementation of "MotionBERT: A Unified Perspective on Learning Human Motion Representations"
Thank you for answer. The method I am using is one of the monocular 3d pose estimation studies, and is as follows. https://github.com/Walter0807/MotionBERT
-
Lox also made OSCMotion, which allows you to send the joint positions via OSC instead. This is pretty scuffed though, since the update rate is far too low for this to look good. It is possible in theory though.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives