In-Air Gesture Interaction for Mixed-Reality Environments

This project investigates the development of a prototype that utilizes in-air gesture shortcuts to interact within a Mixed-Reality environment.

The primary goal was to determine if desktop-style shortcuts can be successfully transferred to freehand gestures while evaluating their user-friendliness and technical limitations. I implemented the concept and prototype in a virtual showroom using my HTC Vive and a Leap Motion controller for hand tracking.

The resulting system utilizes a distinct control concept, separating tasks between a “function hand” to switch modes and a “modification hand” to adjust scalar values via virtual sliders.

Tools: Unity, Figma, Photoshop, Visual Studio Code

Close Menu