facenet-pytorch VS facenet

Hijacking this comment because i've been working nonstop on my project thanks to your suggestion. I'm now using this https://github.com/derronqi/yolov8-face for face detection and still the old face_recognition for encodings. I'm clustering with dbscan and extracting frames with ffmpeg with -hwaccel on. I'm planning to try this: https://github.com/timesler/facenet-pytorch as it looks like it would be the fastest thing avaiable to process videos? Keep in mind i need to perform encoding other than just detection because i want to use DBscan (and later also facial recognition, but this might be done separately just by saving the encodings). let me know if you have any other suggestions, and thanks again for your help

For now, I am trying to evaluate and get the accuracy of the FaceNet module. Like this example on facenet-pytorch, getting the accuracy relies on this file (pairs.txt) provided by the official site. Format description below:

with some python knowledge you can try a two step procedure: 1) extract a number of frames per second, for example five frames (images, i.e. still frames) per second using opencv or ffmpeg 2) Using facenet: detect faces in frames and then classify them by comparing each image to a known image of the person you are looking for.

It's generally better to split the task into a multiple tasks. First I'd want to detect and extract faces. There are a number of pretrained models that you could use for that, e.g. https://github.com/timesler/facenet-pytorch, https://github.com/opencv/opencv/tree/master/data/haarcascades. Once you've extracted faces, you can train a facial recognition using something like a siamese network as you normally would.

As for me, openface is already outdated - the latest release was in 2016. If you look for a library, the easiest to use is ageitgey/face_recognition. The more accurate libraries are davidsandberg/facenet and deepinsight/insightface.

ML training is practically impossible on micro-controllers. Inferencing on the other hand is quite doable, especially if aided by a [TPU coprocessor](https://coral.ai/products/accelerator/). Supposedly with the TPU you can do some quantization-aware training, but I haven't tried this. I am working on a security system that does facial recognition to recognize me and some friends and considers anyone else as an intruder. How I am doing this is by retraining [Facenet](https://github.com/davidsandberg/facenet) with my facial embeddings. Use something like Haar Cascade in OpenCV to get the bounding box for a face and put it through the model to extract face embeddings. You can then save these embeddings as a sort of databases for the faces you want it to recognize during the inferencing phase. After that you can impose something like a SVM classifier to say who in your face database it is. One thing I will note is that the problem is even easier if you are only concerned with one face - in which case it is technically face identification - not recognition. If that is the case, you only need to do a difference calculation between the embeddings you saved during training and the result output from inferencing. If you do end up using the TPU, you can connect to it over USB from inside a container (I only know how to do this in Docker though) too. Hope this was helpful. I am actually looking to use a k8s cluster eventually too as a sort of smart hub for my security system and other devices so I can handle much more traffic (not sure if this is overkill or not on the pi 4s).

He might just be a solid techie because the scripts are freely available on github. https://github.com/davidsandberg/facenet