kalidokit VS face-api.js

I try to animate a ReadyPlayer Me avatar using ThreeJS and Kalidokit (or something else) with MediaPipe Hollisitc Pose. Here is a working JSFiddle :

kalidoface is made by /u/YeeMachineDev and seems to be fully open source https://github.com/yeemachine/kalidokit https://github.com/yeemachine/kalidoface-3d

In terms of software, what you linked used optical tracking. The underlying tech is commonly called machine/computer vision. You can develop your own tracking software, but there's some open source solutions, like OpenCV than make it faster to build apps. (You can use OpenCV with Python bindings to learn the basics somewhat quickly). What you linked uses Kalidokit, an open source solution using TensorFlow.js and Google's MediaPipe.

oh my apologies! may I suggest Kalidoface then? https://kalidoface.com/ free face and arm tracking! plus they have a very friendly discord for troubleshooting

[JS newbie here] I just discovered kalidokit, a vtuber JS app by yeemachine, and I'm trying to figure out how I could play with its look and feel. Do you have any recommendations on how to proceed? In short, I don't know what are the relevant files in the repo, how they are connected and how to run the app on a local machine. Any help would be very helpful! Thanks.

kalidokit

Then I used face-api.js to find the coordinates of each eye.

I already use recognize in my home NAS. It works fine but it's a NextCloud app (it uses tensorflow through face-api.js). I want something portable and easy to use similar to Google Picasa.

https://github.com/justadudewhohacks/face-api.js/ This is what used in web, can't find similar for react native.

For those looking to not only detect, but also vectorize faces (for later comparison against other faces) -- face recognition, try out: face-api.js

https://github.com/justadudewhohacks/face-api.js/

I saw something similar which used P5.js alongside the face-api.js package.

Meanwhile, Lochlann started to work on facial recognition with face-api.js, which was a challenge. Still, the moment he overcame the hurdle and got it working, the team knew it provided many cool opportunities for this project.

For the record - the author considered these two libraries for face detection: https://github.com/vladmandic/human & https://github.com/justadudewhohacks/face-api.js, he chose "vladmandic/human".

I have used https://github.com/justadudewhohacks/face-api.js/ for facial recognition and it works quite well for a self hosted free option.

While I was writing some initial code I found that Vincent Mühler had already created a high-level API called face-api.js built upon TensorFlow.js which wraps all the low-level operations and provides a convenient API for common tasks like face recognition and emotion detection. He also provides lots of example code on his GitHub repository so I was able to build my first emotion recognizer within a matter of minutes.

That's where the problem with your line of thought occurs. I have no relation to that algorithm or its maker(s). It's just a publicly available AI model that a lot of people use.