shumai
tfjs
shumai | tfjs | |
---|---|---|
15 | 29 | |
1,122 | 18,124 | |
0.2% | 0.3% | |
2.2 | 8.6 | |
9 months ago | 8 days ago | |
TypeScript | TypeScript | |
MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
shumai
-
PyTorch Primitives in WebGPU for the Browser
https://github.com/tensorflow/tfjs/tree/master/tfjs-backend-...
([...], tflite-support, tflite-micro)
From facebookresearch/shumai (a JS tensor library) https://github.com/facebookresearch/shumai/issues/122 :
> It doesn't make sense to support anything besides WebGPU at this point. WASM + SIMD is around 15-20x slower on my machine[1]. Although WebGL is more widely supported today, it doesn't have the compute features needed for efficient modern ML (transformers etc) and will likely be a deprecated backend for other frameworks when WebGPU comes online.
tensorflow rust has a struct.Tensor:
-
Why do people curse JS so much, but also say it's better than Python
JS for ML actually does exist https://github.com/facebookresearch/shumai
-
Breaking Up with Python
> It's really a shame that data science, ML, and notebooks are so wrapped up in it. Otherwise we could jettison the whole thing into space
Although I personally feel Python has its place, I contribute to a project that hopes to diversify the ML/scientific computing space with a TypeScript tensor lib called Shumai: https://github.com/facebookresearch/shumai
-
Tinygrad: A simple and powerful neural network framework
Doesn’t really matter for large batch/large model training on GPUs that don’t need much coordination.
But Python speed is one of the main motivations for a JS/TS based ML lib I’m working on: https://github.com/facebookresearch/shumai
-
[D] Using JavaScript for ML Training/Research (not in the browser)
As a hedge against CPython never becoming fast, we're creating a project called Shumai that attempts to deeply integrate with a new JavaScript runtime (Bun[3]).
-
Python 3.11 is much faster than 3.8
You can expose objects. Here's how it is done in Bun: https://github.com/facebookresearch/shumai/blob/main/shumai/...
We've been using this feature heavily in Shumai.
I think you are vastly overestimating the complexity associated with this (user exposed ref-counting/garbage collection) and may not be totally up to date on what's implemented.
- Shumai: Fast Differentiable Tensor Library in TypeScript with Bun and Flashlight
- Shumai: A fast differentiable tensor library for research in TypeScript and JavaScript
-
7% Speedup from Switch to and
This thought is pretty much the exact motivation behind a recent effort I’m helping out with https://github.com/facebookresearch/shumai
tfjs
-
JavaScript Libraries for Implementing Trendy Technologies in Web Apps in 2024
TensorFlow.js
-
Deep Learning in JavaScript
Many people seem to be unaware of tensorflow.js, an official JS implementation of TF
https://github.com/tensorflow/tfjs
I'd love to see PyTorch in JS, but I think unless you get it running on the GPU it won't be able to do much.
-
Machine Learning in NodeJS || Part 1: TensorflowJS Basics
TensorflowJS GitHub Repository
- PyTorch Primitives in WebGPU for the Browser
-
I want to talk about WebGPU
Also, Tensorflow.js WebGPU backend has been in the works for quite some time: https://github.com/tensorflow/tfjs/tree/master/tfjs-backend-...
-
WebGPU Fundamentals
It's a pity that tfjs never truly developed any decent ops. E.g. you need lgamma to implement the cap for zero-inflated poisson regression and tfjs simply doesn't have that: https://github.com/tensorflow/tfjs/issues/2011
-
Chrome Ships WebGPU
People have been doing it for long with WebGL, see eg https://github.com/tensorflow/tfjs and https://cloudblogs.microsoft.com/opensource/2021/09/02/onnx-...
-
How to get rotation (yaw/pitch/roll) from face detection keypoints?
thanks, no not unity, going to show it as a demo with threejs + tensorflow on the web. I found a github request to add face orientation https://github.com/tensorflow/tfjs/issues/3835 looks like they assigned someone to add it but doesn't look like its available yet, but there's some posts about the math I can use to get rotations based on some of the landmarks
-
[P] Supporting neural network inference in web browsers
There already exist a wide variety of neural network inference engines that run in web browsers (e.g. TensorFlow.js and, my personal favorite for use with PyTorch models, ONNX Runtime Web), but pre- and post-processing has always required imperative manipulations on flat buffers rather than a clean ndarray interface.
-
Tensorflow JS model crashing on mobile
Full docs and code: https://github.com/tensorflow/tfjs/tree/master/e2e/benchmarks/local-benchmark
What are some alternatives?
rosettaboy - A gameboy emulator in several different languages
face-api.js - JavaScript API for face detection and face recognition in the browser and nodejs with tensorflow.js
jittor - Jittor is a high-performance deep learning framework based on JIT compiling and meta-operators.
webhl - WebHL is a fork of hlviewer.js that uses the File System Access API to load game assets direct from your computer rather than from a server.
openpilot - openpilot is an open source driver assistance system. openpilot performs the functions of Automated Lane Centering and Adaptive Cruise Control for 250+ supported car makes and models.
lightweight-human-pose-estimation.pytorch - Fast and accurate human pose estimation in PyTorch. Contains implementation of "Real-time 2D Multi-Person Pose Estimation on CPU: Lightweight OpenPose" paper.
devdocs - API Documentation Browser
BlazePose-tensorflow - A third-party Tensorflow Implementation for paper "BlazePose: On-device Real-time Body Pose tracking".
FrameworkBenchmarks - Source for the TechEmpower Framework Benchmarks project
openpose - OpenPose: Real-time multi-person keypoint detection library for body, face, hands, and foot estimation
Pytorch - Tensors and Dynamic neural networks in Python with strong GPU acceleration
firecracker - Secure and fast microVMs for serverless computing.