face-api.js VS tfjs

Then I used face-api.js to find the coordinates of each eye.

I already use recognize in my home NAS. It works fine but it's a NextCloud app (it uses tensorflow through face-api.js). I want something portable and easy to use similar to Google Picasa.

https://github.com/justadudewhohacks/face-api.js/ This is what used in web, can't find similar for react native.

For those looking to not only detect, but also vectorize faces (for later comparison against other faces) -- face recognition, try out: face-api.js

https://github.com/justadudewhohacks/face-api.js/

I saw something similar which used P5.js alongside the face-api.js package.

Meanwhile, Lochlann started to work on facial recognition with face-api.js, which was a challenge. Still, the moment he overcame the hurdle and got it working, the team knew it provided many cool opportunities for this project.

For the record - the author considered these two libraries for face detection: https://github.com/vladmandic/human & https://github.com/justadudewhohacks/face-api.js, he chose "vladmandic/human".

I have used https://github.com/justadudewhohacks/face-api.js/ for facial recognition and it works quite well for a self hosted free option.

While I was writing some initial code I found that Vincent Mühler had already created a high-level API called face-api.js built upon TensorFlow.js which wraps all the low-level operations and provides a convenient API for common tasks like face recognition and emotion detection. He also provides lots of example code on his GitHub repository so I was able to build my first emotion recognizer within a matter of minutes.

That's where the problem with your line of thought occurs. I have no relation to that algorithm or its maker(s). It's just a publicly available AI model that a lot of people use.

TensorFlow.js

Many people seem to be unaware of tensorflow.js, an official JS implementation of TF

https://github.com/tensorflow/tfjs

I'd love to see PyTorch in JS, but I think unless you get it running on the GPU it won't be able to do much.

TensorflowJS GitHub Repository

Also, Tensorflow.js WebGPU backend has been in the works for quite some time: https://github.com/tensorflow/tfjs/tree/master/tfjs-backend-...

It's a pity that tfjs never truly developed any decent ops. E.g. you need lgamma to implement the cap for zero-inflated poisson regression and tfjs simply doesn't have that: https://github.com/tensorflow/tfjs/issues/2011

People have been doing it for long with WebGL, see eg https://github.com/tensorflow/tfjs and https://cloudblogs.microsoft.com/opensource/2021/09/02/onnx-...

thanks, no not unity, going to show it as a demo with threejs + tensorflow on the web. I found a github request to add face orientation https://github.com/tensorflow/tfjs/issues/3835 looks like they assigned someone to add it but doesn't look like its available yet, but there's some posts about the math I can use to get rotations based on some of the landmarks

There already exist a wide variety of neural network inference engines that run in web browsers (e.g. TensorFlow.js and, my personal favorite for use with PyTorch models, ONNX Runtime Web), but pre- and post-processing has always required imperative manipulations on flat buffers rather than a clean ndarray interface.

Full docs and code: https://github.com/tensorflow/tfjs/tree/master/e2e/benchmarks/local-benchmark