Cross-Reality Interaction Techniques: Interacting with Physical Reality while Staying in Virtual Reality
Proceedings of the ACM on Human-Computer Interaction · 30.11.2026 · 10 (7) · 1-27
DOI: 10.1145/3831335 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the ACM on Human-Computer Interaction, online erschienen am 03.11.2026. Verfasst von Dazhuang Teng und 1 weiteren Autor:innen. Die Arbeit nennt 81 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Natural Sciences and Engineering Research Council of Canada.
Abstract (Originalsprache)
Head-mounted displays (HMDs) allow players to immerse themselves in virtual reality (VR). However, players often encounter interruptions that require them to temporarily leave the virtual environment (VE), such as responding to a message or a person entering the room. Interruptions can cause issues both upon leaving and re-entering VR, such as disorientation, frustration, and breaks in presence. To address these challenges, we designed and implemented five cross-reality interaction techniques that allow users to remain in VR while viewing the real world in alternative ways. We evaluated them in a mixed-methods user study (n = 21), where participants completed real-world interruption tasks during VR gameplay, and compared them to physically removing the HMD and using a controller-enabled, embedded full passthrough mode. All techniques were strongly preferred over removing the HMD and helped participants maintain awareness of the VE during interruptions. Participants particularly preferred embedded full passthrough because it enabled rapid transitions between realities. More broadly, instead of focusing on one reality at a time, participants frequently alternated attention between virtual and physical realities to maintain awareness of both. Our findings highlight the importance of lightweight cross-reality interactions for supporting interruptions, gameplay continuity, and mixed-attention play in future VR experiences.
Förderung
- Natural Sciences and Engineering Research Council of Canada
Zitieren
APA
Teng, D., & Mäkelä, V. (2026). Cross-Reality Interaction Techniques: Interacting with Physical Reality while Staying in Virtual Reality. Proceedings of the ACM on Human-Computer Interaction, 10(7), 1-27. https://doi.org/10.1145/3831335
Vancouver
Teng D, Mäkelä V. Cross-Reality Interaction Techniques: Interacting with Physical Reality while Staying in Virtual Reality. Proceedings of the ACM on Human-Computer Interaction. 2026;10(7):1-27. doi:10.1145/3831335
BibTeX
@article{Teng2026,
author = {Teng, Dazhuang and Mäkelä, Ville},
title = {Cross-Reality Interaction Techniques: Interacting with Physical Reality while Staying in Virtual Reality},
journal = {Proceedings of the ACM on Human-Computer Interaction},
year = {2026},
volume = {10},
number = {7},
pages = {1--27},
doi = {10.1145/3831335}
}
EUVIMED