wgpu-mm
webgpu-blas
wgpu-mm | webgpu-blas | |
---|---|---|
1 | 3 | |
50 | 98 | |
- | - | |
8.7 | 4.8 | |
about 2 months ago | 4 months ago | |
WGSL | TypeScript | |
- | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
wgpu-mm
-
Chrome Ships WebGPU
This is very exciting! (I had suspected it would slip to 114)
WebGPU implementations are still pretty immature, but certainly enough to get started with. I've been implementing a Rust + WebGPU ML runtime for the past few months and have enjoyed writing WGSL.
I recently got a 250M parameter LLM running in the browser without much optimisation and it performs pretty well! (https://twitter.com/fleetwood___/status/1638469392794091520)
That said, matmuls are still pretty handicapped in the browser (especially considering the bounds checking enforced in the browser). From my benchmarking I've struggled to hit 50% of theoretical FLOPS, which is cut down to 30% when the bounds checking comes in. (Benchmarks here: https://github.com/FL33TW00D/wgpu-mm)
I look forward to accessing shader cores as they mentioned in the post.
webgpu-blas
-
Chrome Ships WebGPU
Looks like no -- there appears to be no tensor core or similar support and this SGEMM (fp32 matrix multiply) benchmark gets awful results (my laptop gets 330gflops on this when it should be capable of 13000 gflops).
https://github.com/milhidaka/webgpu-blas
-
Modern JavaScript:Everything you missed over the last 10 years(ECMAScript 2020)
I think you will be interested to read this article about the future of data programming in JavaScript (http://benschmidt.org/post/2020-01-15/2020-01-15-webgpu/).
I do think that this kind of thing will be able to be built on top of WebGPU (I saw this experimental POC that did so recently: https://github.com/milhidaka/webgpu-blas). The only issue is that since JavaScript doesn't support operator overloading, the code might be a little less readable.
- JavaScript for Data Science
What are some alternatives?
SHA256-WebGPU - Implementation of sha256 in WGSL
numjs - Like NumPy, in JavaScript
stablehlo - Backward compatible ML compute opset inspired by HLO/MHLO
Material UI - Ready-to-use foundational React components, free forever. It includes Material UI, which implements Google's Material Design.
wgpu-py - Next generation GPU API for Python
pygfx - A python render engine running on wgpu.
next-auth - Authentication for the Web.
tfjs - A WebGL accelerated JavaScript library for training and deploying ML models.
icpts - TypeScript implementation of iterative closest point (ICP) for point cloud registration
web-stable-diffusion - Bringing stable diffusion models to web browsers. Everything runs inside the browser with no server support.