10$ Full Body Tracking! I'm proud to release ToucanTrack (in Beta!). Get decent FBT with the power of 2 PS3 Eye Cameras and AI!

This page summarizes the projects mentioned and recommended in the original post on reddit.com/r/VRchat

Our great sponsors
  • InfluxDB - Access the most powerful time series database as a service
  • Sonar - Write Clean Python Code. Always.
  • ONLYOFFICE ONLYOFFICE Docs — document collaboration in your environment
  • toucan-track

    Achieving Full Body Tracking for VRChat using 2 cameras and machine learning.

    ToucanTrack can be found at the following repository: https://github.com/noahcoolboy/toucan-track/tree/main

  • tensorflow-onnx

    Convert TensorFlow, Keras, Tensorflow.js and Tflite models to ONNX

    They come in the form of tflite models, so I had to convert them to onnx. I used tf2onnx for converting the pose landmark model and tflite2tensorflow for converting the pose detection model. For improving performance, I had created a small script which modified the landmark models for supporting batch inference. This script is not included in the repository, but do tell me if you need it!

  • InfluxDB

    Access the most powerful time series database as a service. Ingest, store, & analyze all types of time series data in a fully-managed, purpose-built database. Keep data forever with low-cost storage and superior data compression.

  • tflite2tensorflow

    Generate saved_model, tfjs, tf-trt, EdgeTPU, CoreML, quantized tflite, ONNX, OpenVINO, Myriad Inference Engine blob and .pb from .tflite. Support for building environments with Docker. It is possible to directly access the host PC GUI and the camera to verify the operation. NVIDIA GPU (dGPU) support. Intel iHD GPU (iGPU) support. Supports inverse quantization of INT8 quantization model.

    They come in the form of tflite models, so I had to convert them to onnx. I used tf2onnx for converting the pose landmark model and tflite2tensorflow for converting the pose detection model. For improving performance, I had created a small script which modified the landmark models for supporting batch inference. This script is not included in the repository, but do tell me if you need it!

  • mediapipe

    Cross-platform, customizable ML solutions for live and streaming media.

    If you're looking for the differences in terms of how inference is done, I recommend you take a look at MediaPipe's source code. MediaPipe doesn't use raw code, but uses a "graph" instead (eg. pose_landmark_cpu.pbtxt), which can be visualised using MediaPipe Viz. I also used axinc-ai/ailia-models as the base (preprocessing, inference, postprocessing, etc...) which I further built upon (keypoint refinement, roi from keypoints, filtering / smoothing, etc...)

  • ailia-models

    The collection of pre-trained, state-of-the-art AI models for ailia SDK

    If you're looking for the differences in terms of how inference is done, I recommend you take a look at MediaPipe's source code. MediaPipe doesn't use raw code, but uses a "graph" instead (eg. pose_landmark_cpu.pbtxt), which can be visualised using MediaPipe Viz. I also used axinc-ai/ailia-models as the base (preprocessing, inference, postprocessing, etc...) which I further built upon (keypoint refinement, roi from keypoints, filtering / smoothing, etc...)

  • opentrack

    Head tracking software for MS Windows, Linux, and Apple OSX

    This looks amazing! I really would like to try it out but I don't feel like downloading CL-Eye Platform SDK from a dropbox. Especially since this is usually a paid product. Are there any possible alternatives for this driver? Something like this one? Thank you!

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts