Project-Lightspeed VS Pion WebRTC

https://github.com/GRVYDEV/Project-Lightspeed is a 'Twitch like' server that does FTL input from OBS. You can run OBS on the Ubuntu desktop and do a desktop capture. Viewers can then watch on the 'Project Lightspeed' host.

I recommend Project-Lightspeed for this. It uses the FTL protocol (similar to the now defunct Mixer) with WebRTC for great latency. I've used it many times for streaming games, etc. and it works well.

Special thanks to the Ryujinx Discord for helping me test and to the Lightspeed Project (https://github.com/GRVYDEV/Project-Lightspeed)!

jellyfin can certainly do what you are looking for, but it seems like you probably don't have enough bandwidth to reliably host the service at home, and may be overkill for your usage... you could set up project lightspeed (https://github.com/GRVYDEV/Project-Lightspeed) on a $5/month VPS and use OBS to stream video with sub 1 second latency, you can install teamspeak or mumble or something on the same VPS for voice chat.

Hey! I recently released an open source live streaming solution and part of it is written in Golang! I’d love more contributors so feel free to look it over! https://github.com/GRVYDEV/Project-Lightspeed

There's nothing particularly difficult on the server side — a quality SFU should be capable to handle on the order of 400 video flows per core, and there are quite a few high-quality free software SFUs available (Janus, Jitsi, ion-sfu, livekit, Galene). To give some perspective: we're using Galene for lectures, and our single-CPU server uses around 40% CPU usage in a room with 120 students (who keep their cameras switched off during the lecture, of course, and only occasionally switch them on to ask questions).

As the grandparent mentioned, the problem is the client side. Since there is no standard videoconferencing protocol, every free software project needs to develop their own clients. And it's difficult for a free software project to have the manpower and expertise to develop quality clients for the web, Android and iOS, so in effect what we currently have are mostly half-baked web clients.

There is some hope, though. The IETF have been working on standard protocols for ingress (https://datatracker.ietf.org/wg/wish/), and if their protocols get deployed, you'll be able to use the same streaming software (think OBS) or IP camera with multiple distinct videoconferencing servers. An interoperable interactive videoconferencing protocol is nowhere near, but as more people understand videoconferencing technology, there is some hope that people will get together and start working on multi-protocol clients (remember Pidgin?).

Full disclosure: I'm the author of Galene (https://galene.org), and I've been actively participating in the Pion community (https://github.com/pion/webrtc) and collaborating with the authors of ion-sfu (https://github.com/pion/ion-sfu) and LiveKit (https://github.com/livekit).

pion/webrtc - GitHub

Thanks! Its using the Pion library[1] which doesn't seem to be using a constant bitrate; that would definitely be an interesting addition though. Sending e.g. zeroes when its not transmitting packets/frames is totally doable, but atm not implemented.

[1] https://github.com/pion/webrtc

The idea was to port Pion, the web RTC library in Go to Rust, and I played a major role in the early days of the project. I was involved in the RTP library, SRTP, and the Multicast DNS. I put in a lot of time, a commodity the strike ensured I had a lot of, and we made a lot of progress. In fact, a lot of people rallied behind the project making it worthy of the title Open source. It currently has almost 2000 stars on Github.

If you want to deal with NAT traversal I recommend doing this with WebRTC ... The pion project is perfect for this.

Check out: https://github.com/pion/webrtc

For getting media out of ffmpeg you have https://github.com/pion/webrtc/tree/master/examples/rtp-forw...

For playing media from disk you have https://github.com/pion/webrtc/tree/master/examples/play-fro...

To see how to accept and process RTCP see https://github.com/pion/webrtc/tree/master/examples/rtcp-pro...