intel-extension-for-tensorflow VS compute-runtime

Intel already has a working GPGPU stack, using oneAPI/SYCL.

They also have arguably pretty good OpenCL support, as well as downstream support for PyTorch and Tensorflow using their custom extensions https://github.com/intel/intel-extension-for-tensorflow and https://github.com/intel/intel-extension-for-pytorch which are actively developed and just recently brought up-to-date with upstream releases.

I tried Intel® Extension for PyTorch* v1.13.10+xpu and intel-extension-for-tensorflow

Yeah I recently stubbled on it when I was looking into buying a 16gb a770 and wondering what was possible now. GitHub Intel extension for tensorflow

Intel publish extensions for PyTorch and Tensorflow. I’ve been working with PyTorch so I just needed to follow these instructions to get everything set up.

Actually I was just on GitHub trying to submit issues related to me testing Intel's PyTorch and Tensorflow extensions when I saw this; it seems that someone has already ported SD over to the tensorflow framework and so you can probably start using intel's extension for tensorflow with it immediately; and according to this article you can use Intel's extension within WSL under windows as well. But unfortunately given how the guy whose issue I linked to has been facing pretty serious performance issues of inferencing taking many minutes longer than it should when using an A770 to do SD-related inferencing, you might be better off waiting for intel's extension for tensorflow versions 1.2 and greater or something like that, so that when it's your turn to use it, Intel has already ironed out most of the major bugs within the software :)

Well... Fuck! https://github.com/intel/compute-runtime/issues/643

For what it's worth, I was able to get IOMMU enabled and iGPU passthrough working for Plex on an Ubuntu 22.04 LXC container with a fresh install of Proxmox 8.0.3 (kenrel 6.2.16-3-pve) on an Intel i5-13400, ASRock B760M Pro RS/D4, also using Intel drivers released early today. I largely followed this guide.

For this little project unless someone chimes in with experience or can point to regarding the RX 6600 XT / 6650 XT / perhaps 7600 I might go with https://github.com/intel/compute-runtime . (They don't have perfect documentation re supported gpus either, the readme table doesn't list DG2, you need to go to releases to see that) . Phoronix reported it as pretty stable when they tested it with kernel 6.2 in March.

Update: I was able to fix my issue. I'm using Ubuntu 22.04.2 LTS and have the newest available kernel, 6.3.1. Installing the drivers via apt does not work, instead I needed to use https://github.com/intel/compute-runtime/releases/

Drivers: https://github.com/intel/compute-runtime/releases

wget https://github.com/intel/compute-runtime/releases/download/22.43.24595.30/intel-level-zero-gpu-dbgsym_1.3.24595.30_amd64.ddeb

For OpenCL HDR/DV tone-mapping, install the extra compute-runtime if running on host.