Human-machine interfaces (HMI) describe any devices that enable humans to interact with machines. In the earliest days of computing, users could only input one process at a time. To save time, several of these processes would be put in sequence, which resulted in a long series of operations without any input from human users. Now, thanks to advances in keyboards, monitors, and touchscreens, humans can immediately enter commands into their computers and can carry out essential operations without needing to sequence or reorder them. They can input the command they need almost instantaneously.
However, some of these essential services require even faster inputs to keep people and personnel aware and protected. Two branches of the United States Military sought novel interface solutions that would quickly display information to pilots and evaluators of cargo and combat aircraft. These systems also needed to be cost-effective to save on development time and taxpayer funding.
Learn more about these advances in human-machine interfaces below:
Head Mounted Displays for Rotorcraft Pilots
Every branch of the U.S. Military employs rotorcraft like helicopters because of their versatility. Their hovering and vertical takeoff/landing (VTOL) capabilities are the primary reasons why these kinds of aircraft are used in nearly every function from aerial combat to search and rescue operations to news media. However, factors like weather, terrain, and pilot fatigue can greatly disrupt the safety and efficacy of helicopters flights, and thus disseminating key information to pilots in flight is vital.
To assist its rotorcraft pilots, the U.S. Army employed a helmet-mounted, near-to-eye display system. This technology ensured that essential information was always in the pilot’s field of view (FOV). However, their previous system was growing outdated, and they needed a replacement. A new system would have to support an external video source and be capable of projecting symbology on or through a helmet-mounted visor in day and night conditions. The Army also required the system to cost less than $10,000 per unit.
Currently, Intellisense is developing a visor projection head-mounted display. This innovation is based on a modular design with a laser pico-projector micro-display combined with an ultra-compact low-profile display light engine. This human-machine interface provides a wide FOV with high-resolution imagery, enabling low-latency performance in a small, lightweight, power-efficient, and rugged structure. Intellisense has demonstrated a prototype that minimized the number of optics required inside the HGU 56P visor, ensuring that the optical train could provide the necessary eye box space for viewing. They also advanced the DDE firmware to support an external video stream to accommodate a night vision sensor. The updated DDE also provides video mixing of the flight computer data is projected to weigh only 0.75 lb, making it suitable for use with quick-release connectors in a 20 G crash environment. Finally, the total cost of the system comes in at less than $10,000, well within the Army’s budgetary requirements.
Handheld 3D-Imaging Device for Inspecting Aircraft
While the U.S. Army needed a head-mounted display for helicopter pilots in flight, the Air Force requested a handheld 3D-imaging device to inspect aircraft. Most inspections require disassembling the aircraft to evaluate every component of the plane. But with advanced imaging tools, mechanics and evaluators could accurately determine the position and orientation of the aircraft being inspected.
To address the Air Force’s needs, Intellisense developed a low-weight, small form factor, “clip-on” device that can be easily attached to existing handheld non-destructive evaluation (NDE) tools. It is co-aligned with the NDE tool’s line-of-sight with a minimum impact on its current application and process. The system is based on the novel integration of time-of-flight imaging and inertial sensors combined with 3D matching and fusion algorithms. By running on real-time hardware that provides precise registration, the handheld NDE coordinate frames anywhere that the aircraft may be deployed or stationed.
The technology is self-referenced, so it is unaffected by a vibration or shock in the surrounding environment. Additionally, it does not depend on ground-based stations or separate fiducial markers to be placed on the aircraft. The system can also operate indoors or out, and it is completely unaffected by sunlight or darkness for day/night operations. Like the head-mounted display developed for the Army, the cost of the final ruggedized system will cost far less than the existing iGPS system.
Not only do these human-machine interfaces fulfill the needs of the U.S. Military, but they have tremendous potential in commercial markets. The near-to-eye, helmet-mounted display could help helicopter pilots in firefighting and search and rescue operations, and the handheld NDE device can assist in the inspection of commercial aircraft. Intellisense develops these innovations to not only serve the needs of military and commercial clients, but to foster a safer, more efficient world.