storage-foundation-api-explainer VS magic-wormhole

We went to absurd lengths to make Wormhole fast and performant.

We use streaming encryption (specifically, the Encrypted Content-Encoding standard also used by the now defunct Firefox Send) so that we can keep memory utilization flat, no matter how large the file.

We take the end-to-end encrypted file data and simultaneously stream it to browser storage and our servers. When a downloader shows up before the file is fully uploaded, we use the browser copy of the data to stream your files to the downloader using WebRTC. This means that they can start downloading even before the files have been uploaded.

Specifically, we use the WebTorrent protocol (which I created). All file data is end-to-end encrypted before leaving the device. It's encrypted yet again in transit by TLS or WebRTC, and also while at rest on our servers.

We use a combination of browser storage options, depending on which is fastest and the amount of available disk space. We choose from the following storage strategies:

- Storage Foundation API (fastest performance, experimental API, Chrome only for now, https://github.com/fivedots/storage-foundation-api-explainer)

Some CLI alternatives if you don't need the GUI:

Croc: https://github.com/schollz/croc

Magic-Wormhole: https://github.com/magic-wormhole/magic-wormhole

I used to use MW but switched to croc as the single binary was easier to deploy.

On a similar note, can someone tell me what's the fastest (wireless) way to transfer files between two laptops on same network (i.e. hotspot)?

scp, rsync, wormhole give me only 2-3 mb/s.

What's causing the bottleneck here and what am I missing? Thanks in advance!

https://github.com/magic-wormhole/magic-wormhole

Check out wormhole. It works on Linux, Windows and MacOS, keeps your data entirely on the private network and uses HTTP as the underlying transfer vehicle. Since HTTP isn't nearly as bothered by high latency (as compared to SMB or FTP), this is probably as fast as you will be able to transfer files on that high latency network.

Related projects:

- FlyingCarpet: direct transfer over local adhoc WIFI: https://github.com/spieglt/FlyingCarpet

- LANDrop: Drop any files to any devices on your LAN: https://github.com/LANDrop/LANDrop

- In-browser file transfer similar to Airdrop: https://snapdrop.net/

- Magic Wormhole: simple file transfer from computer-to-computer over the net: https://github.com/magic-wormhole/magic-wormhole

- Croc: similar to magic wormhole: https://github.com/schollz/croc

- Wormhole: user-friendly in-browser based e2e encrypted file transfer: https://wormhole.app/

You can try https://github.com/magic-wormhole/magic-wormhole

There's the python magic-wormhole if you want a 1-to-1 data transfer just to OP by sharing the info through a chat/dm/whatever.

I prefer bashupload.com or transfer.sh for this. Both alternatives have worked well for me.

Alternatively, you can check out magic wormhole (for a more secure transfer of files between two terminals): https://github.com/magic-wormhole/magic-wormhole

If you do happen to have internet access, this tool is the best: https://github.com/magic-wormhole/magic-wormhole