bot_box VS Pion WebRTC

Glad to hear that! The app is free to use, and quite customizable. Check this repo for details: https://github.com/roboportal/bot_box

Oh, it’s feasible to build the robot with this tool. The platform itself isn’t open sourced, but you can check this repo for the robot controller: https://github.com/roboportal/bot_box and some examples: https://github.com/roboportal/bot_design_examples

I’m facing similar here: https://github.com/roboportal/bot_box on Mac with h264 and on RPi with mmal

I'm building a free platform to build such projects. It consists of a web app: roboportal.io and Golang based software which should operate on the robot's side: https://github.com/roboportal/bot_box. WebRTC part is Pion (https://github.com/pion/webrtc). Also, there are a few more bots examples created with this tool: https://github.com/roboportal/bot\_design\_examples

In my experience Go has been relatively approachable for people that are good at PHP. It has a great standard library and a pretty solid ecosystem, though frameworks aren’t as popular in Go. There are some well regarded libraries for things like WebRTC via https://github.com/pion/webrtc WebSicket via https://github.com/nhooyr/websocket

Don't try to make RTC yourself, it looks easy, but in fact, it's a really hard problem to solve. Use https://pion.ly/ it's a pretty solid package they also have a discord/slack channel with a lot of helpful people there.

Maybe you can reuse some of this code: https://github.com/pion/webrtc/blob/master/examples/data-channels/main.go

- Each sentence is converted to speech in real-time and streamed out to all participants

We also use GPT-3 Turbo instead of GPT-4 which shaves off response time, as well.

To make it easy for anyone to plug in their own AI, we built KITT as a server-side Go program that uses [Pion](https://github.com/pion/webrtc) to publish audio and video streams like any other WebRTC participant. That means it’s fairly straightforward to plug in your own STT, LLM, custom voice or avatar.

For more details on how we built this: [https://blog.livekit.io/meet-kitt](https://blog.livekit.io/m...

To implement this with Go you can use https://pion.ly https://github.com/pion/webrtc

You can run all your WebRTC traffic off a single port. You use the remote 3 tuple (IP, Port, Protocol) to demux traffic.

https://github.com/pion/webrtc/tree/master/examples/ice-sing... is one example of that.

I originally went the same route as you, and found that https://github.com/pion/webrtc is probably the best package out there for webrtc. I learned go just for it, and it paid off tenfold. Less memory, more connections, lower latency.

The "Mediasoup" project provides a high level JavaScript/TypeScript interface to the WebRTC APIs. The core logic of this project is implemented in C++/Rust. Consider taking a look at the project if you want an easy-to-use library instead of the low-level libWebRTC APIs. A notable project to mention is the Pion/webrtc project which has a Golang implementation of the WebRTC API. Of course, we should mention the rust port WebRTC.rs. Let’s keep all the rustaceans happy too!