tfjs
openpose
Our great sponsors
tfjs | openpose | |
---|---|---|
29 | 36 | |
18,110 | 29,867 | |
0.7% | 1.3% | |
8.6 | 5.1 | |
7 days ago | 10 days ago | |
TypeScript | C++ | |
Apache License 2.0 | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
tfjs
-
JavaScript Libraries for Implementing Trendy Technologies in Web Apps in 2024
TensorFlow.js
-
Deep Learning in JavaScript
Many people seem to be unaware of tensorflow.js, an official JS implementation of TF
https://github.com/tensorflow/tfjs
I'd love to see PyTorch in JS, but I think unless you get it running on the GPU it won't be able to do much.
-
Machine Learning in NodeJS || Part 1: TensorflowJS Basics
TensorflowJS GitHub Repository
- PyTorch Primitives in WebGPU for the Browser
-
I want to talk about WebGPU
Also, Tensorflow.js WebGPU backend has been in the works for quite some time: https://github.com/tensorflow/tfjs/tree/master/tfjs-backend-...
-
WebGPU Fundamentals
It's a pity that tfjs never truly developed any decent ops. E.g. you need lgamma to implement the cap for zero-inflated poisson regression and tfjs simply doesn't have that: https://github.com/tensorflow/tfjs/issues/2011
-
Chrome Ships WebGPU
People have been doing it for long with WebGL, see eg https://github.com/tensorflow/tfjs and https://cloudblogs.microsoft.com/opensource/2021/09/02/onnx-...
-
How to get rotation (yaw/pitch/roll) from face detection keypoints?
thanks, no not unity, going to show it as a demo with threejs + tensorflow on the web. I found a github request to add face orientation https://github.com/tensorflow/tfjs/issues/3835 looks like they assigned someone to add it but doesn't look like its available yet, but there's some posts about the math I can use to get rotations based on some of the landmarks
-
[P] Supporting neural network inference in web browsers
There already exist a wide variety of neural network inference engines that run in web browsers (e.g. TensorFlow.js and, my personal favorite for use with PyTorch models, ONNX Runtime Web), but pre- and post-processing has always required imperative manipulations on flat buffers rather than a clean ndarray interface.
-
Tensorflow JS model crashing on mobile
Full docs and code: https://github.com/tensorflow/tfjs/tree/master/e2e/benchmarks/local-benchmark
openpose
-
AI "Artists" Are Lazy, and the Ultimate Goal of AI Image Generation (hint: its sloth)
Open Pose, a multi-person keypoint detection library for body, face, hands, and foot estimation [10], is used for posing generated characters;
-
Analyze defects and errors in the created images
OpenPose
-
[D] Which open source models can replicate wonder dynamics's drag'n'drop cg characters?
Perhaps something like OpenPose for pose estimation?
-
Do we have Locally Run AI mocap yet?
OpenPose looks like what you're looking for, it seems to have plugins for Unity. I can't say I've used it though.
-
Let's take a break!
You are correct. Open Pose has two keypoints for the eyes and two more for the ears. By saying were the ears are you automatically influence the angle of the head. You can see more about it on this github page. Just scroll a tiny bit and you can see a gif of the nodes overlapped on humans
-
Accelerate Machine Learning Local Development and Test Workflows with Nvidia Docker
FROM nvidia/cuda:10.0-cudnn7-devel-ubuntu18.04 # https://hub.docker.com/r/nvidia/cuda ENV DEBIAN_FRONTEND=noninteractive # install the dependencies for building OpenPose RUN apt-get update && # The rest is ignored for brevity. RUN pip3 install --no-cache-dir # The rest is ignored for brevity. # install cmake, clone OpenPose and download models RUN wget https://cmake.org/files/v3.20/cmake-3.20.2-linux-x86_64.tar.gz && \ # The rest is ignored for brevity. WORKDIR /openpose/build RUN alias python=python3 && cmake -DBUILD_PYTHON=OFF -DWITH_GTK=OFF -DUSE_CUDNN=ON .. # Build OpenPose. Cudnn 8 causes memory issues this is why we are using base with CUDA 10 and Cudnn 7 # Fix for CUDA 10.0 and Cudnn 7 based on the post below. # https://github.com/CMU-Perceptual-Computing-Lab/openpose/issues/1753#issuecomment-792431838 RUN sed -ie 's/set(AMPERE "80 86")/#&/g' ../cmake/Cuda.cmake && \ sed -ie 's/set(AMPERE "80 86")/#&/g' ../3rdparty/caffe/cmake/Cuda.cmake && \ make -j`nproc` && \ make install WORKDIR /openpose
- nub needs some directions
-
full body tracking with WiFi signals by utilizing deep learning architectures
One of the best cam only libraries (no depth sensor) I've seen is openpose, I ran it through a 360 camera and it was able to track body, face, and fingers really well even with spherical distortion from the 360 cam. example 360
- How to do body tracking for (real) camera
- How to get rotation (yaw/pitch/roll) from face detection keypoints?
What are some alternatives?
face-api.js - JavaScript API for face detection and face recognition in the browser and nodejs with tensorflow.js
mediapipe - Cross-platform, customizable ML solutions for live and streaming media.
webhl - WebHL is a fork of hlviewer.js that uses the File System Access API to load game assets direct from your computer rather than from a server.
AlphaPose - Real-Time and Accurate Full-Body Multi-Person Pose Estimation&Tracking System
lightweight-human-pose-estimation.pytorch - Fast and accurate human pose estimation in PyTorch. Contains implementation of "Real-time 2D Multi-Person Pose Estimation on CPU: Lightweight OpenPose" paper.
detectron2 - Detectron2 is a platform for object detection, segmentation and other visual recognition tasks.
BlazePose-tensorflow - A third-party Tensorflow Implementation for paper "BlazePose: On-device Real-time Body Pose tracking".
mmpose - OpenMMLab Pose Estimation Toolbox and Benchmark.
firecracker - Secure and fast microVMs for serverless computing.
hyperformula - HyperFormula is an open-source headless spreadsheet for business web apps. It comes with over 400 formulas, CRUD operations, undo-redo, clipboard support, and sorting. Built in TypeScript, supported by the Handsontable Team.