Navigation and Interaction:

Menus:
Google Earth VR maps the controls to buttons on the controller with tooltips floating nearby - as the menu options change the tooltips change.



Vanishing realms has a nice UI at the user's waist where you store keys and food and weapons and then to interact the user intersects that menu with one of the controllers as though you were reaching down to grab something off your belt.



Tilt Brush has a nice 2-handed 3D UI where the multi-faceted menu appears in one hand and you select from it with the other hand.



Bridge Crew has a nice UI with (lots of) buttons that you have to 'press' with your virtual hands (controller) - including virtual overlay text to remind you which is which




Voice:
One way to get around the complexity of the menus is to talk to the computer via a voice recognition system.
However, voice commands can also be hard to learn and remember.
The HoloLens makes effective use of voice to rapidly move through the menus without needing to look and pinch.
Many newer MHD support voice command.

Gesture recognition :
This also seems like a very natural interface. Gloves can be used to accurately track the position of the user's hand and fingers.
One issue here, as with voice, is how does the computer decide that you are gesturing to it and expect something to happen, as opposed to gesturing to yourself or another person.


Haptics:
This also seems like a very natural interface. Gloves can be used to accurately track the position of the user's hand and fingers.


References:
https://xinreality.com/wiki/Positional_tracking
https://www.nap.edu/read/4761/chapter/9#199
https://www.nap.edu/read/4761/chapter/9#189
https://www.roadtovr.com
Some contents on this page were adapted from online resources and Virtual and Augmented Reality class at UIC
© Last revised: Nov 18, 2020