posedance VS tfjs-models

While exploring the art of hand shadows, I wondered whether some of the recent work I had done for body poses might be applicable to hand poses. What if you could tell a story on the web using your hands, and somehow save a video of the show and the narrative behind it, and send it to someone special? In lockdown, what could be more amusing than sharing shadow stories between friends or relatives, all virtually?

I am wondering, will this also work with tensoflow.js or only tflite? I'd like to use this hand pose estimation from mediapipe: https://github.com/tensorflow/tfjs-models/tree/master/hand-pose-detection

I got the basic concept working using TensorFlow QnA model but the answers don't seem very accurate. Infact, unless you specifically ask the exact question, you dont get the right answer. Its not intelligent enough because the entire PDF content becomes a bag of words instead of having context to those words. for eg. When someone types "languages", it should search within a section named Languages.

I think you are beginning to connect the dots by now 😉 What we will do is to build a small proof-of-concept (POC) by writing a simple react app and hook up a pre-trained tensorflow.js model, The text toxicity model to "moderate" the user's text input and show a notification of what's wrong with it, a text toxicity meter if you will...

TensorFlow.js is a JavaScript library developers can use to run pre-trained machine-learning models in the browser. The library has a variety of models for tasks such as object identification and language processing. One of these models is the text toxicity detection model.

TensorFlow has a toxicity classification model available. I don't find it to work that well, but it does something. Not sure if it works in other languages than English. Tried the demo with some offensive Dutch and it passed it.

No clue if it will work on drawn images. It depends on what the model was trained on. The models github is a good place to get started on figuring that out: https://github.com/tensorflow/tfjs-models/tree/body-pix-v2.0.4/body-pix

You probably want to check out something like tensorflow https://github.com/tensorflow/tfjs-models where you can build and test your models.

I decided to start with the toxicity model OOTB demo code for simplicity. You can find this code in their Github repo.