tfjs
mediapipe
Our great sponsors
tfjs | mediapipe | |
---|---|---|
29 | 49 | |
18,110 | 25,405 | |
0.7% | 2.1% | |
8.6 | 9.9 | |
7 days ago | 6 days ago | |
TypeScript | C++ | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
tfjs
-
JavaScript Libraries for Implementing Trendy Technologies in Web Apps in 2024
TensorFlow.js
-
Deep Learning in JavaScript
Many people seem to be unaware of tensorflow.js, an official JS implementation of TF
https://github.com/tensorflow/tfjs
I'd love to see PyTorch in JS, but I think unless you get it running on the GPU it won't be able to do much.
-
Machine Learning in NodeJS || Part 1: TensorflowJS Basics
TensorflowJS GitHub Repository
- PyTorch Primitives in WebGPU for the Browser
-
I want to talk about WebGPU
Also, Tensorflow.js WebGPU backend has been in the works for quite some time: https://github.com/tensorflow/tfjs/tree/master/tfjs-backend-...
-
WebGPU Fundamentals
It's a pity that tfjs never truly developed any decent ops. E.g. you need lgamma to implement the cap for zero-inflated poisson regression and tfjs simply doesn't have that: https://github.com/tensorflow/tfjs/issues/2011
-
Chrome Ships WebGPU
People have been doing it for long with WebGL, see eg https://github.com/tensorflow/tfjs and https://cloudblogs.microsoft.com/opensource/2021/09/02/onnx-...
-
How to get rotation (yaw/pitch/roll) from face detection keypoints?
thanks, no not unity, going to show it as a demo with threejs + tensorflow on the web. I found a github request to add face orientation https://github.com/tensorflow/tfjs/issues/3835 looks like they assigned someone to add it but doesn't look like its available yet, but there's some posts about the math I can use to get rotations based on some of the landmarks
-
[P] Supporting neural network inference in web browsers
There already exist a wide variety of neural network inference engines that run in web browsers (e.g. TensorFlow.js and, my personal favorite for use with PyTorch models, ONNX Runtime Web), but pre- and post-processing has always required imperative manipulations on flat buffers rather than a clean ndarray interface.
-
Tensorflow JS model crashing on mobile
Full docs and code: https://github.com/tensorflow/tfjs/tree/master/e2e/benchmarks/local-benchmark
mediapipe
-
Mediapipe openpose Controlnet model for SD
mediapipe/docs/solutions/pose.md at master · google/mediapipe · GitHub
-
MEDIAPIPE on-device diffusion plugins for conditioned text-to-image generation
Today, we announce MediaPipe diffusion plugins, which enable controllable text-to-image generation to be run on-device. Expanding upon our prior work on GPU inference for on-device large generative models, we introduce new low-cost solutions for controllable text-to-image generation that can be plugged into existing diffusion models and their Low-Rank Adaptation (LoRA) variants.
-
Running a TensorFlow object detector model and drawing boxes around objects at 60 FPS - all in React Native / JavaScript!
You can just grab the TFLite version! https://github.com/google/mediapipe/blob/master/docs/solutions/models.md
-
OpenAI came after our domain because we use GPT in it
I believe Google already released transformers under an apache 2 license with a patent grant:
https://github.com/google/mediapipe/blob/master/mediapipe/mo...
-
Open source Background Remover: Remove Background from images and video using AI
I was going to say that I like the MediaPipe Selfie Segmentation model for doing this sort of thing in a web page, but I've just noticed (when getting the GitHub link[1]) that Google have marked the code as legacy[2] ... no idea if the new solution is better/easier to use[3].
For what it's worth, my CodePen using the old model is here: https://codepen.io/kaliedarik/pen/PopBxBM
[1] - https://github.com/google/mediapipe/blob/master/docs/solutio...
[2] - "Attention: Thank you for your interest in MediaPipe Solutions. As of April 4, 2023, this solution was upgraded to a new MediaPipe Solution."
[3] - https://developers.google.com/mediapipe/solutions/vision/ima...
-
[P] Pattern recognition
I have used mediapipe very successfully in multiple projects and it's very easy to get running. You can choose from many different vision tasks including hand landmarks ( https://github.com/google/mediapipe/blob/master/docs/solutions/hands.md )
-
Getting face feature pose statistics
I found MediaPipe's Face Mesh and was impressed with how simple it was to get going, but it just gives you the landmark points and I've not gone any further yet.
-
New ControlNet Face Model
We've trained ControlNet on a subset of the LAION-Face dataset using modified output from MediaPipe's face mesh annotator to provide a new level of control when generating images of faces.
-
Trained an ML model using TensorFlow.js to classify American Sign Language (ASL) alphabets on browser. We are creating an open-source platform and would love to receive your feedback on our project.
Medipaipe library link: https://mediapipe.dev/
-
mediapipe VS daisykit - a user suggested alternative
2 projects | 24 Mar 2023
What are some alternatives?
face-api.js - JavaScript API for face detection and face recognition in the browser and nodejs with tensorflow.js
openpose - OpenPose: Real-time multi-person keypoint detection library for body, face, hands, and foot estimation
webhl - WebHL is a fork of hlviewer.js that uses the File System Access API to load game assets direct from your computer rather than from a server.
ue4-mediapipe-plugin - UE4 MediaPipe plugin
lightweight-human-pose-estimation.pytorch - Fast and accurate human pose estimation in PyTorch. Contains implementation of "Real-time 2D Multi-Person Pose Estimation on CPU: Lightweight OpenPose" paper.
Pytorch - Tensors and Dynamic neural networks in Python with strong GPU acceleration
BlazePose-tensorflow - A third-party Tensorflow Implementation for paper "BlazePose: On-device Real-time Body Pose tracking".
AlphaPose - Real-Time and Accurate Full-Body Multi-Person Pose Estimation&Tracking System
firecracker - Secure and fast microVMs for serverless computing.
jeelizFaceFilter - Javascript/WebGL lightweight face tracking library designed for augmented reality webcam filters. Features : multiple faces detection, rotation, mouth opening. Various integration examples are provided (Three.js, Babylon.js, FaceSwap, Canvas2D, CSS3D...).