I was of the impression that Tesla's self driving is still not fully reliable yet. For example a recent video shows a famous youtuber having to take manual control 3 times in a 20 min drive to work [0]. He mentioned how stressful it was compared to normal driving as well.
I'm assuming that the mouse/keyboard can begin processing as soon as the network call is done. If true that's about 5ms.
Keep in mind that different mice vary in their latency. Even wired mice can vary from 1.5ms to more than 25ms in click latency [1]. So if you use a low latency mouse over the network, it could be faster than some mice that are plugged in directly.
On fast paced games that run at 100+ fps, I don't really notice it being missing. But in games that have high graphics, and lower FPS, it's noticeable.
For my setup, I do a "local" version of Geforce Now.
I have my gaming PC in another room and stream it to my laptop using Nvidia's GameStream and Moonlight. I run it at 1440p with 120fps. With everything connected via ethernet, I get an end-to-end latency of 7ms. This means my stream is only just 1 frame behind the PC.
I use this setup for fast-paced games as well as regular PC usage. 99% of the time, I can't tell that it's a remote stream.
The advantages of the setup are:
1. Don't have to deal with the heat and noise of my gaming PC being in my room.
2. Switching between my laptop and gaming PC is faster than using a hardware KVM switch.
3. I can easily stream games or use my PC remotely with tablets and phones.
Disadvantages are:
1. Gamestream and Moonlight don't support streaming dual screens at once.
2. Gsync doesn't work over streaming. So lower frame rates (< 60fps) aren't as smooth as native.
I probably game on it more than my gaming PC and consoles at this point.