mediapipe VS opentrack

mediapipe/docs/solutions/pose.md at master · google/mediapipe · GitHub

Today, we announce MediaPipe diffusion plugins, which enable controllable text-to-image generation to be run on-device. Expanding upon our prior work on GPU inference for on-device large generative models, we introduce new low-cost solutions for controllable text-to-image generation that can be plugged into existing diffusion models and their Low-Rank Adaptation (LoRA) variants.

You can just grab the TFLite version! https://github.com/google/mediapipe/blob/master/docs/solutions/models.md

I believe Google already released transformers under an apache 2 license with a patent grant:

https://github.com/google/mediapipe/blob/master/mediapipe/mo...

I was going to say that I like the MediaPipe Selfie Segmentation model for doing this sort of thing in a web page, but I've just noticed (when getting the GitHub link[1]) that Google have marked the code as legacy[2] ... no idea if the new solution is better/easier to use[3].

For what it's worth, my CodePen using the old model is here: https://codepen.io/kaliedarik/pen/PopBxBM

[1] - https://github.com/google/mediapipe/blob/master/docs/solutio...

[2] - "Attention: Thank you for your interest in MediaPipe Solutions. As of April 4, 2023, this solution was upgraded to a new MediaPipe Solution."

[3] - https://developers.google.com/mediapipe/solutions/vision/ima...

I have used mediapipe very successfully in multiple projects and it's very easy to get running. You can choose from many different vision tasks including hand landmarks ( https://github.com/google/mediapipe/blob/master/docs/solutions/hands.md )

I found MediaPipe's Face Mesh and was impressed with how simple it was to get going, but it just gives you the landmark points and I've not gone any further yet.

We've trained ControlNet on a subset of the LAION-Face dataset using modified output from MediaPipe's face mesh annotator to provide a new level of control when generating images of faces.

Medipaipe library link: https://mediapipe.dev/

I want to buy something like TrackIR (I don't know much about equivalent products). My friend told me about a DIY tracker that I could use (opentrack).

Out of curiosity, do you have a formed opinion on Opentrack for 6DOF support? It would be cool to have a little input plugin from your software for the XREAL into Opentrack! I usually play Il-2 1946 and other flight sims on a docked Steam Deck, and opentrack + android phone with AI recognition is a god send.

I'm attempting to install on Nobara 37 and saw #1558.

Per https://github.com/opentrack/opentrack/issues/1453 , it looks as though bookworm is affected by the badly-thought-out https://gitlab.com/procps-ng/procps/-/commit/d974f064b5a269fe8bd009d1430d17218aaf07b7

Use this tutorial: https://github.com/opentrack/opentrack/wiki/PS3-Eye-open-driver-instructions

Download the latest release of Opentrack. Install it, and when it launches change Input to "UDP over newtork" and Output to "freetrack 2.0 Enhanced".

FreePIE + OpenTrack.

I think you’ve got the wrong sub. But I thank you. I’ve learnt a load figuring out your acronyms! For anyone not following trackir is this https://www.trackir.com/trackir5/ (which looks remarkably similar to a head mouse extreme which you can’t buy). It’s head tracking. Not eyegaze. You may be interested in https://github.com/google/project-gameface and facetracknoir http://facetracknoir.sourceforge.net/home/default.htm freetrack http://www.free-track.net/english/ And opentrack https://github.com/opentrack/opentrack