laskin.live
wgpu-mm
| laskin.live | wgpu-mm | |
|---|---|---|
| 2 | 1 | |
| 6 | 42 | |
| - | - | |
| 10.0 | 8.7 | |
| over 3 years ago | about 2 months ago | |
| HTML | WGSL | |
| MIT License | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
laskin.live
-
Chrome Ships WebGPU
For anyone figuring out how to run webgpu on a remote computer (over webrtc) , see this: https://github.com/periferia-labs/laskin.live
Not sure if it works anymore (I made it 3 years ago), but will be interesting to see if there will be similar products for LLMs and so now.
-
WebRTC.rs reached an important milestone in connectivity!
Shameless plug but a friend of mine and I combined both WebRTC and WebGPU some time ago: https://github.com/periferia-labs/laskin.live
wgpu-mm
-
Chrome Ships WebGPU
This is very exciting! (I had suspected it would slip to 114)
WebGPU implementations are still pretty immature, but certainly enough to get started with. I've been implementing a Rust + WebGPU ML runtime for the past few months and have enjoyed writing WGSL.
I recently got a 250M parameter LLM running in the browser without much optimisation and it performs pretty well! (https://twitter.com/fleetwood___/status/1638469392794091520)
That said, matmuls are still pretty handicapped in the browser (especially considering the bounds checking enforced in the browser). From my benchmarking I've struggled to hit 50% of theoretical FLOPS, which is cut down to 30% when the bounds checking comes in. (Benchmarks here: https://github.com/FL33TW00D/wgpu-mm)
I look forward to accessing shader cores as they mentioned in the post.
What are some alternatives?
rivi-loader - Vulkan Compute program loader in Rust
SHA256-WebGPU - Implementation of sha256 in WGSL
stablehlo - Backward compatible ML compute opset inspired by HLO/MHLO
wgpu-py - Next generation GPU API for Python
pygfx - A python render engine running on wgpu.
tfjs - A WebGL accelerated JavaScript library for training and deploying ML models.
webgpu-blas - Fast matrix-matrix multiplication on web browser using WebGPU
web-stable-diffusion - Bringing stable diffusion models to web browsers. Everything runs inside the browser with no server support.
gpuweb - Where the GPU for the Web work happens!
burn - Burn is a new comprehensive dynamic Deep Learning Framework built using Rust with extreme flexibility, compute efficiency and portability as its primary goals.
mach - zig game engine & graphics toolkit