Exploring the Human-Centric Interaction Paradigm: Augmented Reality-Assisted Head-Up Display Design for Collaborative Human-Machine Interface in Cockpit

Human-cybernetic interfaces (HCI) focuses on the integration and synergy of human-centric design, human factors (HFs) and economics, and human–machine interaction (HMI). The scrutiny of single pilot operations (SPO) approval from civil aviation authorities (CAAs) is subject to the aviation safety and pilot capability during exceptional handling and flight emergency. Airliners advocate the possibility from dual pilot operations (DPO) to SPO because of the financial considerations and captain shortage in the post-pandemic era. One could expect that SPO can only realise when reduced crew operations initiative is proven to be safe and airworthy. Public concerns pilot mental workload and potentially low situational awareness (SA) when handling overwhelmed multi-source information from the HMI in a cockpit, leading to degraded skills and flying performance. Advanced head up display (HUD) design, an integrated transparent display, can assist pilots in maintaining their optimal performance when SPO exercised. In this study, we are interested to design a SPO-favoured cockpit design with HUD and investigate the potential of integrating augmented reality (AR) and HUD in SPO in flight operations. An experiment involving 21 pilots was conducted to assess the effectiveness of AR-HUD on SA and workload in DPO, SPO, and SPO with AR-HUD scenarios. The Situation Awareness Present Assessment Method (SPAM) and a self-rated workload scale were used to evaluate SA and workload levels. Eye-tracking data was also collected to analyse behavioural performance. Results indicated that the AR-HUD scenario achieved optimal workload and SA levels and demonstrated superior performance in handling emergencies. Eye-tracking data revealed that AR-HUD facilitated a more equitable distribution of gaze between instruments and external view. In conclusion, the integration of AR in cockpit design introduces a human-centric interaction paradigm, contributing to aviation safety, SPO implementation and adaptive HMI design.