wgpu-mm
stablehlo
| wgpu-mm | stablehlo | |
|---|---|---|
| 1 | 5 | |
| 50 | 333 | |
| - | 4.2% | |
| 8.7 | 9.8 | |
| about 2 months ago | 7 days ago | |
| WGSL | MLIR | |
| - | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
wgpu-mm
-
Chrome Ships WebGPU
This is very exciting! (I had suspected it would slip to 114)
WebGPU implementations are still pretty immature, but certainly enough to get started with. I've been implementing a Rust + WebGPU ML runtime for the past few months and have enjoyed writing WGSL.
I recently got a 250M parameter LLM running in the browser without much optimisation and it performs pretty well! (https://twitter.com/fleetwood___/status/1638469392794091520)
That said, matmuls are still pretty handicapped in the browser (especially considering the bounds checking enforced in the browser). From my benchmarking I've struggled to hit 50% of theoretical FLOPS, which is cut down to 30% when the bounds checking comes in. (Benchmarks here: https://github.com/FL33TW00D/wgpu-mm)
I look forward to accessing shader cores as they mentioned in the post.
stablehlo
-
Nvidia H200 Tensor Core GPU
I am going to paste a cousin comment:
StableHLO[1] is an interesting project that might help AMD here:
> Our goal is to simplify and accelerate ML development by creating more interoperability between various ML frameworks (such as TensorFlow, JAX and PyTorch) and ML compilers (such as XLA and IREE).
From there, their goal would most likely be to work with XLA/OpenXLA teams on XLA[3] and IREE[2] to make RoCM a better backend.
[1] https://github.com/openxla/stablehlo
[2] https://github.com/openxla/iree
[3] https://www.tensorflow.org/xla
-
Chrome Ships WebGPU
Also see the recently introduced StableHLO and its serialization format: https://github.com/openxla/stablehlo/blob/main/docs/bytecode...
-
OpenXLA Is Available Now
If you mean StableHLO, then it has an MLIR dialect: https://github.com/openxla/stablehlo/blob/main/stablehlo/dia....
In the StableHLO spec, we are talking about this in more abstract terms - "StableHLO opset" - to be able to unambiguously reason about the semantics of StableHLO programs. However, in practice the StableHLO dialect is the primary implementation of the opset at the moment.
I wrote "primary implementation" because e.g. there is also ongoing work on adding StableHLO support to the TFLite flatbuffer schema: https://github.com/tensorflow/tensorflow/blob/master/tensorf.... Having an abstract notion of the StableHLO opset enables us to have a source of truth that all the implementations correspond to.
What are some alternatives?
SHA256-WebGPU - Implementation of sha256 in WGSL
wonnx - A WebGPU-accelerated ONNX inference run-time written 100% in Rust, ready for native and the web
wgpu-py - Next generation GPU API for Python
pygfx - A python render engine running on wgpu.
iree - A retargetable MLIR-based machine learning compiler and runtime toolkit.
tfjs - A WebGL accelerated JavaScript library for training and deploying ML models.
SHARK - SHARK - High Performance Machine Learning Distribution
webgpu-blas - Fast matrix-matrix multiplication on web browser using WebGPU
glare-core - C++ code used in various Glare Tech Ltd products
web-stable-diffusion - Bringing stable diffusion models to web browsers. Everything runs inside the browser with no server support.
mach - zig game engine & graphics toolkit