yolov8-face VS facenet-pytorch

Hello. Q1: I have a large collection of files from which i have to encode faces. Until now, the fastest way i've found is to use a yolov8 finetune model (https://github.com/derronqi/yolov8-face) for face detection and the face_recognition library for encoding in a 128. I've tried using deepface but it's much slower.

Hijacking this comment because i've been working nonstop on my project thanks to your suggestion. I'm now using this https://github.com/derronqi/yolov8-face for face detection and still the old face_recognition for encodings. I'm clustering with dbscan and extracting frames with ffmpeg with -hwaccel on. I'm planning to try this: https://github.com/timesler/facenet-pytorch as it looks like it would be the fastest thing avaiable to process videos? Keep in mind i need to perform encoding other than just detection because i want to use DBscan (and later also facial recognition, but this might be done separately just by saving the encodings). let me know if you have any other suggestions, and thanks again for your help

Hijacking this comment because i've been working nonstop on my project thanks to your suggestion. I'm now using this https://github.com/derronqi/yolov8-face for face detection and still the old face_recognition for encodings. I'm clustering with dbscan and extracting frames with ffmpeg with -hwaccel on. I'm planning to try this: https://github.com/timesler/facenet-pytorch as it looks like it would be the fastest thing avaiable to process videos? Keep in mind i need to perform encoding other than just detection because i want to use DBscan (and later also facial recognition, but this might be done separately just by saving the encodings). let me know if you have any other suggestions, and thanks again for your help

For now, I am trying to evaluate and get the accuracy of the FaceNet module. Like this example on facenet-pytorch, getting the accuracy relies on this file (pairs.txt) provided by the official site. Format description below:

with some python knowledge you can try a two step procedure: 1) extract a number of frames per second, for example five frames (images, i.e. still frames) per second using opencv or ffmpeg 2) Using facenet: detect faces in frames and then classify them by comparing each image to a known image of the person you are looking for.

It's generally better to split the task into a multiple tasks. First I'd want to detect and extract faces. There are a number of pretrained models that you could use for that, e.g. https://github.com/timesler/facenet-pytorch, https://github.com/opencv/opencv/tree/master/data/haarcascades. Once you've extracted faces, you can train a facial recognition using something like a siamese network as you normally would.