EUVIMEDOpdag EUVIMED
Open access · CC BY 4.0

Cross-Reality Interaction Techniques: Interacting with Physical Reality while Staying in Virtual Reality

Dazhuang Teng, Ville Mäkelä

Proceedings of the ACM on Human-Computer Interaction · 2026-11-30 · 10 (7) · 1-27

DOI: 10.1145/3831335 ↗

At a glance

Journal article in Proceedings of the ACM on Human-Computer Interaction, published online on 2026-11-03. Written by Dazhuang Teng and 1 co-authors. 81 references. The full text is freely available (open access, CC BY 4.0). Funded by: Natural Sciences and Engineering Research Council of Canada.

AbstractBibliografiske oplysningerCiteRelated studies

Abstract (original language)

Head-mounted displays (HMDs) allow players to immerse themselves in virtual reality (VR). However, players often encounter interruptions that require them to temporarily leave the virtual environment (VE), such as responding to a message or a person entering the room. Interruptions can cause issues both upon leaving and re-entering VR, such as disorientation, frustration, and breaks in presence. To address these challenges, we designed and implemented five cross-reality interaction techniques that allow users to remain in VR while viewing the real world in alternative ways. We evaluated them in a mixed-methods user study (n = 21), where participants completed real-world interruption tasks during VR gameplay, and compared them to physically removing the HMD and using a controller-enabled, embedded full passthrough mode. All techniques were strongly preferred over removing the HMD and helped participants maintain awareness of the VE during interruptions. Participants particularly preferred embedded full passthrough because it enabled rapid transitions between realities. More broadly, instead of focusing on one reality at a time, participants frequently alternated attention between virtual and physical realities to maintain awareness of both. Our findings highlight the importance of lightweight cross-reality interactions for supporting interruptions, gameplay continuity, and mixed-attention play in future VR experiences.

Funding

  • Natural Sciences and Engineering Research Council of Canada

Cite

APA

Teng, D., & Mäkelä, V. (2026). Cross-Reality Interaction Techniques: Interacting with Physical Reality while Staying in Virtual Reality. Proceedings of the ACM on Human-Computer Interaction, 10(7), 1-27. https://doi.org/10.1145/3831335

Vancouver

Teng D, Mäkelä V. Cross-Reality Interaction Techniques: Interacting with Physical Reality while Staying in Virtual Reality. Proceedings of the ACM on Human-Computer Interaction. 2026;10(7):1-27. doi:10.1145/3831335

BibTeX
@article{Teng2026,
  author = {Teng, Dazhuang and Mäkelä, Ville},
  title = {Cross-Reality Interaction Techniques: Interacting with Physical Reality while Staying in Virtual Reality},
  journal = {Proceedings of the ACM on Human-Computer Interaction},
  year = {2026},
  volume = {10},
  number = {7},
  pages = {1--27},
  doi = {10.1145/3831335}
}
Start for free →