Simple peer-to-peer with WebRTC
Sadly I have no experience with Godot. In any case, you need a server to make the connection between the peers. As you put yourself, prior to an established connection the two parties can't find one another on the web. As long as your game isn't big enough to pay for a server, you could use https://peerjs.com/ 's.
PeerJS - Simple peer-to-peer with WebRTC
1 project | reddit.com/r/opensource | 23 Feb 2022
Realtime ASCII filter using smartphone camera
1 project | reddit.com/r/TouchDesigner | 3 Feb 2022
How to implement peer to peer connection?
1 project | reddit.com/r/webdev | 30 Jun 2021
🍿My lockdown project Flickcall - transforming streaming platform to virtual movie theaters [Demo attached]
2 projects | reddit.com/r/webdev | 14 May 2021