10$ Full Body Tracking! I'm proud to release ToucanTrack (in Beta!). Get decent FBT with the power of 2 PS3 Eye Cameras and AI!

• toucan-track

  2 36 4.1 Python

  Achieving Full Body Tracking for VRChat using 2 cameras and machine learning.

ToucanTrack can be found at the following repository: https://github.com/noahcoolboy/toucan-track/tree/main

• tensorflow-onnx

  7 2,210 7.4 Jupyter Notebook

  Convert TensorFlow, Keras, Tensorflow.js and Tflite models to ONNX

  

They come in the form of tflite models, so I had to convert them to onnx. I used tf2onnx for converting the pose landmark model and tflite2tensorflow for converting the pose detection model. For improving performance, I had created a small script which modified the landmark models for supporting batch inference. This script is not included in the repository, but do tell me if you need it!

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• tflite2tensorflow

  2 249 0.0 Python

  Generate saved_model, tfjs, tf-trt, EdgeTPU, CoreML, quantized tflite, ONNX, OpenVINO, Myriad Inference Engine blob and .pb from .tflite. Support for building environments with Docker. It is possible to directly access the host PC GUI and the camera to verify the operation. NVIDIA GPU (dGPU) support. Intel iHD GPU (iGPU) support. Supports inverse quantization of INT8 quantization model.

They come in the form of tflite models, so I had to convert them to onnx. I used tf2onnx for converting the pose landmark model and tflite2tensorflow for converting the pose detection model. For improving performance, I had created a small script which modified the landmark models for supporting batch inference. This script is not included in the repository, but do tell me if you need it!

• mediapipe

  49 25,405 9.9 C++

  Cross-platform, customizable ML solutions for live and streaming media.

  

If you're looking for the differences in terms of how inference is done, I recommend you take a look at MediaPipe's source code. MediaPipe doesn't use raw code, but uses a "graph" instead (eg. pose_landmark_cpu.pbtxt), which can be visualised using MediaPipe Viz. I also used axinc-ai/ailia-models as the base (preprocessing, inference, postprocessing, etc...) which I further built upon (keypoint refinement, roi from keypoints, filtering / smoothing, etc...)

• ailia-models

  4 1,814 9.8 Python

  The collection of pre-trained, state-of-the-art AI models for ailia SDK

  

If you're looking for the differences in terms of how inference is done, I recommend you take a look at MediaPipe's source code. MediaPipe doesn't use raw code, but uses a "graph" instead (eg. pose_landmark_cpu.pbtxt), which can be visualised using MediaPipe Viz. I also used axinc-ai/ailia-models as the base (preprocessing, inference, postprocessing, etc...) which I further built upon (keypoint refinement, roi from keypoints, filtering / smoothing, etc...)

• opentrack

  204 3,298 8.6 C++

  Head tracking software for MS Windows, Linux, and Apple OSX

  

This looks amazing! I really would like to try it out but I don't feel like downloading CL-Eye Platform SDK from a dropbox. Especially since this is usually a paid product. Are there any possible alternatives for this driver? Something like this one? Thank you!

Suggest a related project