stablehlo VS tfjs

I am going to paste a cousin comment:

StableHLO[1] is an interesting project that might help AMD here:

> Our goal is to simplify and accelerate ML development by creating more interoperability between various ML frameworks (such as TensorFlow, JAX and PyTorch) and ML compilers (such as XLA and IREE).

From there, their goal would most likely be to work with XLA/OpenXLA teams on XLA[3] and IREE[2] to make RoCM a better backend.

[1] https://github.com/openxla/stablehlo

[2] https://github.com/openxla/iree

[3] https://www.tensorflow.org/xla

Also see the recently introduced StableHLO and its serialization format: https://github.com/openxla/stablehlo/blob/main/docs/bytecode...

If you mean StableHLO, then it has an MLIR dialect: https://github.com/openxla/stablehlo/blob/main/stablehlo/dia....

In the StableHLO spec, we are talking about this in more abstract terms - "StableHLO opset" - to be able to unambiguously reason about the semantics of StableHLO programs. However, in practice the StableHLO dialect is the primary implementation of the opset at the moment.

I wrote "primary implementation" because e.g. there is also ongoing work on adding StableHLO support to the TFLite flatbuffer schema: https://github.com/tensorflow/tensorflow/blob/master/tensorf.... Having an abstract notion of the StableHLO opset enables us to have a source of truth that all the implementations correspond to.

TensorFlow.js

Many people seem to be unaware of tensorflow.js, an official JS implementation of TF

https://github.com/tensorflow/tfjs

I'd love to see PyTorch in JS, but I think unless you get it running on the GPU it won't be able to do much.

TensorflowJS GitHub Repository

Also, Tensorflow.js WebGPU backend has been in the works for quite some time: https://github.com/tensorflow/tfjs/tree/master/tfjs-backend-...

It's a pity that tfjs never truly developed any decent ops. E.g. you need lgamma to implement the cap for zero-inflated poisson regression and tfjs simply doesn't have that: https://github.com/tensorflow/tfjs/issues/2011

People have been doing it for long with WebGL, see eg https://github.com/tensorflow/tfjs and https://cloudblogs.microsoft.com/opensource/2021/09/02/onnx-...

thanks, no not unity, going to show it as a demo with threejs + tensorflow on the web. I found a github request to add face orientation https://github.com/tensorflow/tfjs/issues/3835 looks like they assigned someone to add it but doesn't look like its available yet, but there's some posts about the math I can use to get rotations based on some of the landmarks

There already exist a wide variety of neural network inference engines that run in web browsers (e.g. TensorFlow.js and, my personal favorite for use with PyTorch models, ONNX Runtime Web), but pre- and post-processing has always required imperative manipulations on flat buffers rather than a clean ndarray interface.

Full docs and code: https://github.com/tensorflow/tfjs/tree/master/e2e/benchmarks/local-benchmark