IrisBarracuda
MediaPipeUnityPlugin
| IrisBarracuda | MediaPipeUnityPlugin | |
|---|---|---|
| 1 | 7 | |
| 117 | 1,617 | |
| - | - | |
| 4.4 | 8.8 | |
| about 1 year ago | 22 days ago | |
| C# | C# | |
| Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
IrisBarracuda
-
Open map with gaze tracking for someone with paralysis
There are only a few libraries that come to mind but take a bit of work to get started. MediaPipe Unity Plugin has eye tracking with a whole lot of types of tracking(head, hands, body). OpenSeeFace has models that do head and eye tracking. This repo uses Unity's neural net inference library, Barracuda, to run a MediaPipe iris landmark model (I haven't personally tested this library). Not sure how to translate eye landmarks to the position a player is looking at in a screen though. Hopefully this list of libraries gets you on the right path!
MediaPipeUnityPlugin
- any hand detect api or plugin that I can use in arfoundation?
-
Unity Visual Scripting and Hand Tracking
Look into Playmaker and Mediapipe.
-
MediaPipe in Unity
You should really specify where you got stuck. In any event, there are compiled packages here https://github.com/homuler/MediaPipeUnityPlugin/releases YMMV.
-
Been working on a VTuber App
This person has ported the majority of the C++ API to Unity's C#, Github link here. Assuming they've ported it one-to-one, you'd be using the same API I use, just in C# (I've not tried it though)
-
When I call it "AR Experience"?
Also, there is a MedeaPipeUnityPlugin.
-
Open map with gaze tracking for someone with paralysis
There are only a few libraries that come to mind but take a bit of work to get started. MediaPipe Unity Plugin has eye tracking with a whole lot of types of tracking(head, hands, body). OpenSeeFace has models that do head and eye tracking. This repo uses Unity's neural net inference library, Barracuda, to run a MediaPipe iris landmark model (I haven't personally tested this library). Not sure how to translate eye landmarks to the position a player is looking at in a screen though. Hopefully this list of libraries gets you on the right path!
-
3D Realtime Pose Detection with MediaPipe and Unity3D.
Checkout https://github.com/homuler/MediaPipeUnityPlugin
What are some alternatives?
OpenSeeFace - Robust realtime face and facial landmark tracking on CPU with Unity integration
AssetStudio - AssetStudio is a tool for exploring, extracting and exporting assets and assetbundles.
ILSpy - .NET Decompiler with support for PDB generation, ReadyToRun, Metadata (&more) - cross-platform!
Entitas - Entitas is a super fast Entity Component System (ECS) Framework specifically made for C# and Unity
ml-agents - The Unity Machine Learning Agents Toolkit (ML-Agents) is an open-source project that enables games and simulations to serve as environments for training intelligent agents using deep reinforcement learning and imitation learning.
lively - Free and open-source software that allows users to set animated desktop wallpapers and screensavers powered by WinUI 3.
VRigUnity - VRM hand tracking using mediapipe
FaceMeshBarracuda - Lightweight facial capture package for Unity