Microsoft's now shut down Mixer (formerly Beam.pro) primarly used WebRTC and had streams with up to 100k viewers at some point all via WebRTC, but can't find much info about it anymore now sadly.
Yeah it supports generic tcp forwarding, I only tried it once when it released but worked without issues. Needs cloudflared on the client as well but so does the method in the blogpost so should be about the same:
> You could see that by how little RAM ended up being used in llama.cpp when they moved to mmaping the model.
From what I've read that was just an error in reading memory consumption after switching to the mmap version and not more memory efficient at all in the end.
Tested on Intel MacOS 12.5 PC with AMD 8GB RX 580 GPU, about 28 secs for 20 steps, surprisingly fast too.
I did have to go to chrome://flags and enable "Unsafe WebGPU" even on Chrome Canary (113.0.5656.0) before it would work, otherwise I just got "no adapter" errors.
They could still be doing that through an Apple hosted proxy though? I believe services like discord and gmail webclient do that for links to not leak IPs.
BetterTouchTool has a lot of overlap with AHK I believe. Lets you remap keyboard/mouse actions globally and/or per application and perform actions or run scripts on keyboard/mouse input ands lots of features of that kind.
(Never used AHK myself but the couple times I looked for something similar to BetterTouchTool on Windows I got recommended AHK)
As far as I know the simple SSH "port forwarding" (-L and -R) used here is just layer 4 reading/writing from one TCP socket to another (plus some multiplexing/encryption in between) and doesn't suffer from any TCP over TCP problems, only the ssh tun forwarding option (-w) is level 2/3 and has that issue but that seems to be much more rarely used.
