EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Reframing human–robot interaction through extended reality: Unlocking safer, smarter, and more empathic interactions with virtual robots and foundation models

Yuchong Zhang, Yong Ma, Danica Kragic

Empathic Computing · 2026

DOI: 10.70401/ec.2026.0018 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Empathic Computing, 2026. Verfasst von Yuchong Zhang und 2 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 141 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This perspective reframes human–robot interaction (HRI) through extended reality (XR), arguing that virtual robots powered by large foundation models (FMs) can serve as cognitively grounded, empathic agents. Unlike physical robots, XR-native agents are unbound by hardware constraints and can be instantiated, adapted, and scaled on demand, while still affording embodiment and co-presence. We synthesize work across XR, HRI, and cognitive AI to show how such agents can support safety-critical scenarios, socially and cognitively empathic interaction across domains, and extend physical capabilities with XR and AI integration. We then discuss how multimodal large FMs (e.g., large language models, large vision models, and vision-language models) enable context-aware reasoning, affect-sensitive situations, and long-term adaptation, positioning virtual robots as cognitive and empathic mediators rather than mere simulation assets. At the same time, we highlight challenges and potential risks, including overtrust, cultural and representational bias, privacy concerns around biometric sensing, and data governance and transparency. The paper concludes by outlining a research agenda for human-centered, ethically grounded XR agents, emphasizing multi-layered evaluation frameworks, multi-user ecosystems, mixed virtual–physical embodiment, and societal and ethical design practices to envision XR-based virtual agents powered by FMs as reshaping future HRI into a more efficient and adaptive paradigm.

Zitieren

APA

Zhang, Y., Ma, Y., & Kragic, D. (2026). Reframing human–robot interaction through extended reality: Unlocking safer, smarter, and more empathic interactions with virtual robots and foundation models. Empathic Computing. https://doi.org/10.70401/ec.2026.0018

Vancouver

Zhang Y, Ma Y, Kragic D. Reframing human–robot interaction through extended reality: Unlocking safer, smarter, and more empathic interactions with virtual robots and foundation models. Empathic Computing. 2026. doi:10.70401/ec.2026.0018

BibTeX
@article{Zhang2026,
  author = {Zhang, Yuchong and Ma, Yong and Kragic, Danica},
  title = {Reframing human–robot interaction through extended reality: Unlocking safer, smarter, and more empathic interactions with virtual robots and foundation models},
  journal = {Empathic Computing},
  year = {2026},
  doi = {10.70401/ec.2026.0018}
}
Kostenlos starten →