EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Gaze-Preserving Visual Aids For Selecting Out-Of-View Switches In a Virtual Reality Aircraft Cockpit

Stefan Auer, Christoph Anthes, Harald Reiterer, Hans-Christian Jetter

Proceedings of the ACM on Human-Computer Interaction · 23.11.2026 · 10 (8) · 1-19

DOI: 10.1145/3859321 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the ACM on Human-Computer Interaction, online erschienen am 20.11.2026. Verfasst von Stefan Auer und 3 weiteren Autor:innen. Die Arbeit nennt 48 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In safety-critical interactive spaces, such as flight decks, pilots must be able to maintain a forward-facing visual attention to monitor primary instruments, current weather, or other aircraft. However, typical flight decks require interaction with switches that are located outside the pilot’s view. Short, well-practiced glances at controls are part of normal cockpit operation. Longer shifts of attention away from the monitoring task to locate controls can cause problematic situations, including unnoticed changes in surrounding traffic and flight path deviations. In physical cockpits, pilots can safely rely on haptic and tactile features to select a control without looking. However, as modern pilot training increasingly transitions to Virtual Reality Flight Simulations (VRFS) to reduce costs, this crucial tactile reference is lost. Without this tactile reference in Virtual Reality (VR), trainees rely on visual guidance during switch selection, which can divert attention from the monitoring task. To resolve these VRFS-related limitations, we introduce and evaluate two techniques that enable monitoring while interacting in VR using gaze-preserving peripheral views: an orthographic ( V Ortho ) and a perspective-correct ( V Persp ) representation of the corresponding cockpit panel. Furthermore, we present a dynamic height indicator to help users determine the remaining distance between the virtual fingertip and the desired cockpit element. In a within-subjects study, 28 participants with no aviation experience compared both techniques with an unassisted baseline in a high-fidelity VR Boeing 737-800 cockpit. Our findings show that both views successfully lower error rates on the monitoring task. However, this benefit comes with trade-offs: both views increase task completion times and subjective workload (as measured by NASA-TLX). The number of missed switches, normalized path error (NPE), and pre- to post-study SSQ scores showed no notable degradation, indicating that users adapted well to the peripheral views without adverse effects.

Zitieren

APA

Auer, S., Anthes, C., Reiterer, H., & Jetter, H. (2026). Gaze-Preserving Visual Aids For Selecting Out-Of-View Switches In a Virtual Reality Aircraft Cockpit. Proceedings of the ACM on Human-Computer Interaction, 10(8), 1-19. https://doi.org/10.1145/3859321

Vancouver

Auer S, Anthes C, Reiterer H, Jetter H. Gaze-Preserving Visual Aids For Selecting Out-Of-View Switches In a Virtual Reality Aircraft Cockpit. Proceedings of the ACM on Human-Computer Interaction. 2026;10(8):1-19. doi:10.1145/3859321

BibTeX
@article{Auer2026,
  author = {Auer, Stefan and Anthes, Christoph and Reiterer, Harald and Jetter, Hans-Christian},
  title = {Gaze-Preserving Visual Aids For Selecting Out-Of-View Switches In a Virtual Reality Aircraft Cockpit},
  journal = {Proceedings of the ACM on Human-Computer Interaction},
  year = {2026},
  volume = {10},
  number = {8},
  pages = {1--19},
  doi = {10.1145/3859321}
}
Kostenlos starten →