VRigUnity
MediaPipeUnityPlugin


VRigUnity | MediaPipeUnityPlugin | |
---|---|---|
3 | 7 | |
179 | 1,916 | |
2.2% | 2.1% | |
3.4 | 8.6 | |
9 months ago | 9 days ago | |
C# | C# | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
VRigUnity
-
Are there any other software besides VSeeFace for vrm models?
All of the following have mediapipe / VMC Protocol Support (for webcam / you can use your phone as a webcam on your PC with IVCam + IVCam server for windows): Webcam Motion Capture (Paid): https://webcammotioncapture.info/ V Rig Unity (free): https://github.com/Kariaro/VRigUnity XR Animator (free): https://github.com/ButzYung/SystemAnimatorOnline/releases V Actor (free): https://github.com/endink/VActor
-
Software
(Free) https://github.com/Kariaro/VRigUnity
-
What tracker to use?
I use VseeFace to VNyan with iPhone X (IFacialMocap), if you want to have body and hand tracking you can use : https://github.com/Kariaro/VRigUnity but the hand/body tracking (webcam) use a lot of performance in CPU
MediaPipeUnityPlugin
- any hand detect api or plugin that I can use in arfoundation?
-
Unity Visual Scripting and Hand Tracking
Look into Playmaker and Mediapipe.
-
MediaPipe in Unity
You should really specify where you got stuck. In any event, there are compiled packages here https://github.com/homuler/MediaPipeUnityPlugin/releases YMMV.
-
Been working on a VTuber App
This person has ported the majority of the C++ API to Unity's C#, Github link here. Assuming they've ported it one-to-one, you'd be using the same API I use, just in C# (I've not tried it though)
-
When I call it "AR Experience"?
Also, there is a MedeaPipeUnityPlugin.
-
Open map with gaze tracking for someone with paralysis
There are only a few libraries that come to mind but take a bit of work to get started. MediaPipe Unity Plugin has eye tracking with a whole lot of types of tracking(head, hands, body). OpenSeeFace has models that do head and eye tracking. This repo uses Unity's neural net inference library, Barracuda, to run a MediaPipe iris landmark model (I haven't personally tested this library). Not sure how to translate eye landmarks to the position a player is looking at in a screen though. Hopefully this list of libraries gets you on the right path!
-
3D Realtime Pose Detection with MediaPipe and Unity3D.
Checkout https://github.com/homuler/MediaPipeUnityPlugin
What are some alternatives?
VirtualMotionCapture - VRゲーム中にモデルをコントロール
ILSpy - .NET Decompiler with support for PDB generation, ReadyToRun, Metadata (&more) - cross-platform!
OpenLive3D.github.io - Connect Camera to VRM with Web
ml-agents - The Unity Machine Learning Agents Toolkit (ML-Agents) is an open-source project that enables games and simulations to serve as environments for training intelligent agents using deep reinforcement learning and imitation learning.
SystemAnimatorOnline - XR Animator, AI-based Full Body Motion Capture and Extended Reality (XR) solution, powered by System Animator Online
Entitas - Entitas is a super fast Entity Component System (ECS) Framework specifically made for C# and Unity
EasyVirtualMotionCaptureForUnity - VMCProtocol Receiver asset for Unity. Easy to use! / バーチャルモーションキャプチャーなどVMCProtocolを受信してUnityに反映するスクリプトです。
AssetStudio - AssetStudio is a tool for exploring, extracting and exporting assets and assetbundles.
VActor - Virtual Actor : Motion capture for your 3D avatar.
OpenSeeFace - Robust realtime face and facial landmark tracking on CPU with Unity integration
Unity_VRoid_Facial_Expression - In this tutorial, you'll learn how to change facial expressions on our VRoid character through the use of Blendshapes and animations in Unity
FaceMeshBarracuda - Lightweight facial capture package for Unity

