How to transmit custom signal to vrchat world (AI guided 3d keypoints)

This page summarizes the projects mentioned and recommended in the original post on /r/VRchat

CodeRabbit: AI Code Reviews for Developers
Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.
coderabbit.ai
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured
  1. UNet

    Network system for VRChat UDON (by Xytabich)

    Summary: I've implemented real-time mono-webcam full body tracking, but I'm having trouble sending this data to vrchat. This function was actually implemented on Unity, and socket communication was used in Unity. Is there a socket communication method that works with udonsharp or vrchat? Here are the solutions I reviewed. https://github.com/Xytabich/UNet I think Unet is very similar to the solution I was looking for, but the connection ID uses the person object that entered the world. I want to receive data from outside.

  2. CodeRabbit

    CodeRabbit: AI Code Reviews for Developers. Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.

    CodeRabbit logo
  3. midi-websocket

    Send midi through websockets

    https://github.com/fa-m/midi-websocket MIDI websockets pose a fundamental question to me. This solution is difficult to analyze and emphasizes the importance of security.

  4. ShaderMotion

    This only works for your own avatar though. If you want to make something that is displayed in a single world you can look into ShaderMotion, which is a system to bring humanoid poses into VRC worlds. The data is sent via a video feed (as blinking pixels) and a shader then reads out those pixels and "animates" the model accordingly.

  5. MotionBERT

    [ICCV 2023] PyTorch Implementation of "MotionBERT: A Unified Perspective on Learning Human Motion Representations"

    Thank you for answer. The method I am using is one of the monocular 3d pose estimation studies, and is as follows. https://github.com/Walter0807/MotionBERT

  6. OSCMotion

    Lox also made OSCMotion, which allows you to send the joint positions via OSC instead. This is pretty scuffed though, since the update rate is far too low for this to look good. It is possible in theory though.

  7. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • Play/pause button for Unity and/or AVPro video players?

    1 project | /r/VRchat | 8 Dec 2022
  • Hi ^^ I want to share my world in VRC

    4 projects | /r/VRchat | 22 Mar 2022
  • Can some ELI5 the difference between Udon, Unity & Blender?

    1 project | /r/VRchat | 17 Feb 2022
  • Can I use c# instead of Udon for scripting?

    1 project | /r/VRchat | 22 Oct 2021
  • Kurotori Udon Kart System

    3 projects | /r/VRchat | 19 Oct 2021