facenet-pytorch VS OpenCV

Hijacking this comment because i've been working nonstop on my project thanks to your suggestion. I'm now using this https://github.com/derronqi/yolov8-face for face detection and still the old face_recognition for encodings. I'm clustering with dbscan and extracting frames with ffmpeg with -hwaccel on. I'm planning to try this: https://github.com/timesler/facenet-pytorch as it looks like it would be the fastest thing avaiable to process videos? Keep in mind i need to perform encoding other than just detection because i want to use DBscan (and later also facial recognition, but this might be done separately just by saving the encodings). let me know if you have any other suggestions, and thanks again for your help

For now, I am trying to evaluate and get the accuracy of the FaceNet module. Like this example on facenet-pytorch, getting the accuracy relies on this file (pairs.txt) provided by the official site. Format description below:

with some python knowledge you can try a two step procedure: 1) extract a number of frames per second, for example five frames (images, i.e. still frames) per second using opencv or ffmpeg 2) Using facenet: detect faces in frames and then classify them by comparing each image to a known image of the person you are looking for.

It's generally better to split the task into a multiple tasks. First I'd want to detect and extract faces. There are a number of pretrained models that you could use for that, e.g. https://github.com/timesler/facenet-pytorch, https://github.com/opencv/opencv/tree/master/data/haarcascades. Once you've extracted faces, you can train a facial recognition using something like a siamese network as you normally would.

Referenceshttps https://www.kaggle.com/datasets/riyaelizashaju/skin-disease-image-dataset-balanced?fbclid=IwAR3wbTp8l5yo_5fx6HAX8Vd2-9cca3khAc8EiBGFObaALfdVid29IuB_rYE https://keras.io/api/applications/vgg/ https://www.tensorflow.org/tutorials/images/cnn?hl=th https://opencv.org/

Data analysis involves scrutinizing datasets for class imbalances or protected features and understanding their correlations and representations. A classical tool like pandas would be my obvious choice for most of the analysis, and I would use OpenCV or Scikit-Image for image-related tasks.

You'll need to plot the predictions. There are a few open source tools to do that, supervision is one you can use (https://github.com/roboflow/supervision) and opencv is another common option (https://github.com/opencv/opencv)

You might be able to achieve this with scripting tools like AutoHotkey or Python with libraries for GUI automation and image recognition (e.g., PyAutoGUI https://pyautogui.readthedocs.io/en/latest/, OpenCV https://opencv.org/).

The OpenCV4NodeJs A.I. library provides an interface for calling OpenCV routines in NodeJS.