EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Failure-Aware Adaptation for Free-Hand Interaction in Mixed Reality

Doris Gutiérrez-Rosales, Arie E. Kaufman

Multimodal Technologies and Interaction · 13.11.2026 · 10 (11) · 122

DOI: 10.3390/mti10110122 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Multimodal Technologies and Interaction, online erschienen am 13.11.2026. Verfasst von Doris Gutiérrez-Rosales und 1 weiteren Autor:innen. Die Arbeit nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NSF.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Free-hand interaction in Mixed Reality (MR) can become difficult as the interaction technique, target geometry, and spatial context vary. We present FAIR-MR, a failure-aware adaptive interaction system that responds to unsuccessful interaction through geometric interventions. Two user studies characterize interaction difficulty across gestures and spatial conditions, and then compare Static, Precomputed, and Online Bandit strategies for selecting interventions. Interaction success varied across gestures, with target geometry affecting interaction techniques differently. The adaptation strategies produced distinct intervention and interaction patterns. Within Online Bandit, intervention estimates became increasingly differentiated with experience, and greater pre-decision differentiation was associated with subsequent recovery. However, this policy development did not produce higher aggregate success than the other strategies. These findings reveal how interaction conditions, intervention strategies, and learned policy behavior shape adaptive interaction. FAIR-MR contributes a system-level approach connecting interaction difficulty, intervention selection, interface changes, transition costs, and recovery.

Förderung

  • NSF

Zitieren

APA

Gutiérrez-Rosales, D., & Kaufman, A. E. (2026). Failure-Aware Adaptation for Free-Hand Interaction in Mixed Reality. Multimodal Technologies and Interaction, 10(11), 122. https://doi.org/10.3390/mti10110122

Vancouver

Gutiérrez-Rosales D, Kaufman AE. Failure-Aware Adaptation for Free-Hand Interaction in Mixed Reality. Multimodal Technologies and Interaction. 2026;10(11):122. doi:10.3390/mti10110122

BibTeX
@article{GutirrezRosales2026,
  author = {Gutiérrez-Rosales, Doris and Kaufman, Arie E.},
  title = {Failure-Aware Adaptation for Free-Hand Interaction in Mixed Reality},
  journal = {Multimodal Technologies and Interaction},
  year = {2026},
  volume = {10},
  number = {11},
  pages = {122},
  doi = {10.3390/mti10110122}
}
Kostenlos starten →