Gaming could be much be better on a VR/AR device, and a reason to put on a "ugly sweat box" initially. Apple did not go deep into that, only a brief segment about the Unity collab. Maybe gaming is not their forte right now.
Apple Vision v3 will not be a sweat box. And even right now, Occulus interface has to evolve to match this. Controller has to be optional. It has to be AR.