Integrated Head-Mounted Display Interface for Hands-Free Control

Eye tracking and voice recognition provides a means for hands-free control of information displayed within a head-mounted display (HMD) device. This proposal outlines a program for combining eye tracking, voice recognition, and HMD technology to achieve an integrated hands-free soldier interface. With this device the soldier can quickly adapt displayed information to meet changing needs of the tactical environment. The proposed system will utilize real-time HMD eye tracking technology and interface evaluation tools developed by Cybernet Systems Corporation, as well as a commercial voice recognition package, to implement a rapid prototype in the Phase I. This prototype will be based on desktop computer/workstation operation. Miniature components and features will be identified for a portable, lightweight version to be implemented in a follow-on Phase II project. The proposed project will offer significant opportunities for commercialization in both military/government and industrial sectors. Applications include the soldier interface, remote driving enhancement, remote surgery applications, and many other virtual reality applications.