Failure-Aware Adaptation for Free-Hand Interaction in Mixed Reality
Multimodal Technologies and Interaction · 13.11.2026 · 10 (11) · 122
DOI: 10.3390/mti10110122 ↗Kurz gefasst
Fachartikel in der Zeitschrift Multimodal Technologies and Interaction, online erschienen am 13.11.2026. Verfasst von Doris Gutiérrez-Rosales und 1 weiteren Autor:innen. Die Arbeit nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NSF.
Abstract (Originalsprache)
Free-hand interaction in Mixed Reality (MR) can become difficult as the interaction technique, target geometry, and spatial context vary. We present FAIR-MR, a failure-aware adaptive interaction system that responds to unsuccessful interaction through geometric interventions. Two user studies characterize interaction difficulty across gestures and spatial conditions, and then compare Static, Precomputed, and Online Bandit strategies for selecting interventions. Interaction success varied across gestures, with target geometry affecting interaction techniques differently. The adaptation strategies produced distinct intervention and interaction patterns. Within Online Bandit, intervention estimates became increasingly differentiated with experience, and greater pre-decision differentiation was associated with subsequent recovery. However, this policy development did not produce higher aggregate success than the other strategies. These findings reveal how interaction conditions, intervention strategies, and learned policy behavior shape adaptive interaction. FAIR-MR contributes a system-level approach connecting interaction difficulty, intervention selection, interface changes, transition costs, and recovery.
Förderung
- NSF
Zitieren
APA
Gutiérrez-Rosales, D., & Kaufman, A. E. (2026). Failure-Aware Adaptation for Free-Hand Interaction in Mixed Reality. Multimodal Technologies and Interaction, 10(11), 122. https://doi.org/10.3390/mti10110122
Vancouver
Gutiérrez-Rosales D, Kaufman AE. Failure-Aware Adaptation for Free-Hand Interaction in Mixed Reality. Multimodal Technologies and Interaction. 2026;10(11):122. doi:10.3390/mti10110122
BibTeX
@article{GutirrezRosales2026,
author = {Gutiérrez-Rosales, Doris and Kaufman, Arie E.},
title = {Failure-Aware Adaptation for Free-Hand Interaction in Mixed Reality},
journal = {Multimodal Technologies and Interaction},
year = {2026},
volume = {10},
number = {11},
pages = {122},
doi = {10.3390/mti10110122}
}
EUVIMED