wgpu-mm
tfjs
| wgpu-mm | tfjs | |
|---|---|---|
| 1 | 29 | |
| 50 | 18,135 | |
| - | 0.4% | |
| 8.7 | 8.6 | |
| about 2 months ago | 7 days ago | |
| WGSL | TypeScript | |
| - | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
wgpu-mm
-
Chrome Ships WebGPU
This is very exciting! (I had suspected it would slip to 114)
WebGPU implementations are still pretty immature, but certainly enough to get started with. I've been implementing a Rust + WebGPU ML runtime for the past few months and have enjoyed writing WGSL.
I recently got a 250M parameter LLM running in the browser without much optimisation and it performs pretty well! (https://twitter.com/fleetwood___/status/1638469392794091520)
That said, matmuls are still pretty handicapped in the browser (especially considering the bounds checking enforced in the browser). From my benchmarking I've struggled to hit 50% of theoretical FLOPS, which is cut down to 30% when the bounds checking comes in. (Benchmarks here: https://github.com/FL33TW00D/wgpu-mm)
I look forward to accessing shader cores as they mentioned in the post.
tfjs
-
JavaScript Libraries for Implementing Trendy Technologies in Web Apps in 2024
TensorFlow.js
-
Deep Learning in JavaScript
Many people seem to be unaware of tensorflow.js, an official JS implementation of TF
https://github.com/tensorflow/tfjs
I'd love to see PyTorch in JS, but I think unless you get it running on the GPU it won't be able to do much.
-
Machine Learning in NodeJS || Part 1: TensorflowJS Basics
TensorflowJS GitHub Repository
- PyTorch Primitives in WebGPU for the Browser
-
I want to talk about WebGPU
Also, Tensorflow.js WebGPU backend has been in the works for quite some time: https://github.com/tensorflow/tfjs/tree/master/tfjs-backend-...
-
WebGPU Fundamentals
It's a pity that tfjs never truly developed any decent ops. E.g. you need lgamma to implement the cap for zero-inflated poisson regression and tfjs simply doesn't have that: https://github.com/tensorflow/tfjs/issues/2011
-
Chrome Ships WebGPU
People have been doing it for long with WebGL, see eg https://github.com/tensorflow/tfjs and https://cloudblogs.microsoft.com/opensource/2021/09/02/onnx-...
-
How to get rotation (yaw/pitch/roll) from face detection keypoints?
thanks, no not unity, going to show it as a demo with threejs + tensorflow on the web. I found a github request to add face orientation https://github.com/tensorflow/tfjs/issues/3835 looks like they assigned someone to add it but doesn't look like its available yet, but there's some posts about the math I can use to get rotations based on some of the landmarks
-
[P] Supporting neural network inference in web browsers
There already exist a wide variety of neural network inference engines that run in web browsers (e.g. TensorFlow.js and, my personal favorite for use with PyTorch models, ONNX Runtime Web), but pre- and post-processing has always required imperative manipulations on flat buffers rather than a clean ndarray interface.
-
Tensorflow JS model crashing on mobile
Full docs and code: https://github.com/tensorflow/tfjs/tree/master/e2e/benchmarks/local-benchmark
What are some alternatives?
SHA256-WebGPU - Implementation of sha256 in WGSL
face-api.js - JavaScript API for face detection and face recognition in the browser and nodejs with tensorflow.js
stablehlo - Backward compatible ML compute opset inspired by HLO/MHLO
webhl - WebHL is a fork of hlviewer.js that uses the File System Access API to load game assets direct from your computer rather than from a server.
wgpu-py - Next generation GPU API for Python
lightweight-human-pose-estimation.pytorch - Fast and accurate human pose estimation in PyTorch. Contains implementation of "Real-time 2D Multi-Person Pose Estimation on CPU: Lightweight OpenPose" paper.
pygfx - A python render engine running on wgpu.
BlazePose-tensorflow - A third-party Tensorflow Implementation for paper "BlazePose: On-device Real-time Body Pose tracking".
webgpu-blas - Fast matrix-matrix multiplication on web browser using WebGPU
openpose - OpenPose: Real-time multi-person keypoint detection library for body, face, hands, and foot estimation
web-stable-diffusion - Bringing stable diffusion models to web browsers. Everything runs inside the browser with no server support.
firecracker - Secure and fast microVMs for serverless computing.