Show HN: Attaching to a Virtual GPU over TCP

1. LibreCuda

   1 2 1,012 8.5 C

   

   sorry, I didn't mean nvapi, I meant rmapi.

   I bet you saw this https://github.com/mikex86/LibreCuda

   they implemented the cuda driver by calling into rmapi.

   My understanding is if there is a remote rmapi, other user mode drivers should work out of the box?

2. SaaSHub

   www.saashub.com featured

   SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

   

3. ffmpeg-over-ip

   2 3 317 7.3 JavaScript

   Connect to remote ffmpeg servers

   

   Ah this is quite interesting! I had a usecase where I needed a GPU-over-IP but only for transcoding videos. I had a not-so-powerful AMD GPU in my homelab server that somehow kept crashing the kernel any time I tried to encode videos with it and also an NVIDIA RTX 3080 in a gaming machine.

   So I wrote https://github.com/steelbrain/ffmpeg-over-ip and had the server running in the windows machine and the client in the media server (could be plex, emby, jellyfin etc) and it worked flawlessly.

4. pocl

   3 4 948 9.9 C

   pocl - Portable Computing Language

   

5. qCUDA

   4 2 114 0.0 C

   qCUDA: GPGPU Virtualization at a New API Remoting Method with Para-virtualization

6. Juice-Labs

   5 21 525 8.7 Go

   Juice Community Version Public Release

   

   There is a GPU-over-network software called Juice [1]. I've used it on AWS for running CPU-intensive workloads that also happen to need some GPU without needing to use a huge GPU instance. I was able to use a small GPU instance, which had just 4 CPU cores, and stream its GPU to one with 128 CPU cores.

   I found Juice to work decently for graphical applications too (e.g., games, CAD software). Latency was about what you'd expect for video encode + decode + network: 5-20ms on a LAN if I recall correctly.

   [1] - https://github.com/Juice-Labs/Juice-Labs

Suggest a related project