cloud-game VS Pion WebRTC

Have you considered CloudRetro?

https://github.com/giongto35/cloud-game Sounds exactly like what you are trying to do.

This is nice. I'm wondering, since this uses a windows VM, as long as there is no dedicated GPU passed through this is probably restricted to older/graphically less intensive games right? Sadly most servers at least from the places I get my servers from don't have at least a cheapo GPU in there to pass through.

I have had a similiar idea some time ago but way less automated and windows-only. Will see if I can contribute anything useful.

Slightly OT: I found CloudRetro[0] and this project some time ago when dabbling in WebRTC and looking at Pion[1]. Interestingly I had a very similiar idea back then and even managed to create a working prototype. Basically cloud-gaming-multiplayer on a single browser page, including 4 low-latency streams for the 4 players and one slightly higher-latency stream for "spectators" (using OvenMediaEngine[2]).

It currently only supports gamepads but allows you do join/leave the game at any time, or leave and let a spectator have a go.

I'd like to open source it sometime soon but currently its barely functional. I'm using a brokenly modified version of the OBS[3] FFMpeg plugin to pump video and audio over RTP to Pion. OBS likes to crash randomly now (due to me not knowing what I'm doing in regards to changing codec parameters etc). Also I still have issues with still frames when there is minimal movement (h264) or the frame freezing and disintegrating into a pixelated mess (using vp8).

Of course the OBS setup requires a bit more setup (and I believe there is no headless-functionality for it?). I'm using a spare windows machine to to stream the games (usually Mario Kart Double Dash (Gamecube)). I even tried a short session in VR with others in BigScreen[4].

Just throwing some ideas for others out I guess.

[0] https://github.com/giongto35/cloud-game

Checkout https://github.com/giongto35/cloud-game and then the same devs latter project https://github.com/giongto35/cloud-morph. That sounds like what you want.

I am really excited about https://github.com/sepfy/libpeer. It has examples ready for ESP32 etc....

When working on KVS I wasn't familiar with the embedded space at all. I saw 'heavyweight' embedded where you were running on Linux. Then you had RTOS/No OS at all. I wasn't prepared for these devices at all. If we can make WebRTC work in the embedded space I think it will really accelerate what developers are able to build!

Remotely driven cars, security cameras, robots in hospitals that bring iPads to infectious patients etc... Creative people are building amazing things. The WebRTC/video space needs to work harder and support them :)

-----

I love how diverse the WebRTC space is now. Outside of this implementation you have plenty of other options!

* https://github.com/shinyoshiaki/werift-webrtc (Typescript)

* https://github.com/pion/webrtc (Golang)

* https://github.com/webrtc-rs/webrtc (Rust)

* https://github.com/algesten/str0m (Rust)

* hhttps://github.com/sepfy/libpeer (C/Embedded)

* https://webrtc.googlesource.com/src/ (C++)

* https://github.com/sipsorcery-org/sipsorcery (C#)

* https://github.com/paullouisageneau/libdatachannel (C++)

* https://github.com/elixir-webrtc (Elixir)

* https://github.com/aiortc/aiortc (Python)

* GStreamer’s webrtcbin (C)

See https://github.com/sipsorcery/webrtc-echoes for examples of some running against each other.

I have worked four jobs related to https://github.com/pion/webrtc and one for https://webrtcforthecurious.com

Two companies used Pion. The other two were just using the protocol (WebRTC)

In my experience Go has been relatively approachable for people that are good at PHP. It has a great standard library and a pretty solid ecosystem, though frameworks aren’t as popular in Go. There are some well regarded libraries for things like WebRTC via https://github.com/pion/webrtc WebSicket via https://github.com/nhooyr/websocket

Don't try to make RTC yourself, it looks easy, but in fact, it's a really hard problem to solve. Use https://pion.ly/ it's a pretty solid package they also have a discord/slack channel with a lot of helpful people there.

Maybe you can reuse some of this code: https://github.com/pion/webrtc/blob/master/examples/data-channels/main.go