Virtual reality (VR) and augmented reality (AR) immerse users in a total simulation with the use of headsets and head-mounted displays. So what differentiates these two technologies? Virtual reality employs headsets or multi-projected displays to recreate a full 360° environment, whereas augmented reality enables users to interact with objects in the real world. Although VR and AR are mostly synonymous with gaming, they are incredibly important in medical or military training, particularly surgeries and aircraft repairs. Both these applications enable users to interact in virtual or controlled environments before they complete essential operations in real life.
In 2019, the U.S. Navy wanted to take advantage of this technology for their flight simulator systems. They required their new system to employ full motion tracking, which allowed the trainee to see cockpit instruments and windows for a variety of aircraft. While a typical simulator can replicate the dashboard for only one aircraft, this innovative flight simulator could duplicate hundreds of different instruments for hundreds of different planes, saving the Navy millions of dollars. They also requested that the simulator system eliminate any impacts to human factor qualities and allow for at least two pilots to interact safely during missions.
To address this need, Intellisense Systems developed a new wide-angle augmented reality headset based on an innovative integration of a wide field-of-view (FOV) aplanatic reflective collimator optics. This system integrates a high-resolution laser light engine, a full-motion head and eye tracker, and a multiplexed video parsing electronic processor. The field-of-view for the system also reached 120° horizontally and 60° vertically, exceeding the Navy’s requirements.
A proof-of-concept laid a solid foundation for the final prototype. The prototype employs two to three light engines per eye to tile images at an HD resolution (1920 x 1080 pixels) required by the Navy. The driver electronics also connect the Navy’s image generators to these light engines. The final design also includes eye/head trackers to provide feedback on the gaze/head position to the image generators for correcting/selecting viewpoints to project.
This wasn’t the only innovation from Intellisense in the field of VR, AR, and mixed reality (MR). They also pioneered a lightweight, night vision heads-up display system with cross-band infrared sensing specially for ground soldiers. Now troops in the field have greater situational awareness in all conditions.
Intellisense has finished the design and assembly of both these VR/AR solutions and are completing more laboratory testing before they are put into full and final product. The additional laboratory testing includes indoor ambient and low-light evaluations for the heads-up display system to bolster its night-vision capabilities even more. With both of these solutions, Intellisense hopes to greatly improve the safety of pilots and ground soldiers in any form of combat.