Zack freedman made a video [0] last year where he created a wearable glove that tracked hand movements to achieve something similar to what you describe. Seemed really cool, and I'm sure we will get something better than this in the not-too-distant future.
[0]: https://www.youtube.com/watch?v=6raRftH9yxM