EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Next Generation XR Systems—Large Language Models Meet Augmented and Virtual Reality

Muhamamd Zeshan Afzal, Sk Aziz Ali, Didier Stricker, Peter Eisert, Anna Hilsmann, Daniel Perez-Marcos, Marco Bianchi, Sonia Crottaz-Herbette, Roberto De Ioris, Eleni Mangina, Mirco Sanguineti, Ander Salaberria und 3 weitere

IEEE Computer Graphics and Applications · 2025-01 · 45 (1) · 43-55

DOI: 10.1109/mcg.2025.3548554 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Computer Graphics and Applications, 2025-01. Verfasst von Muhamamd Zeshan Afzal und 14 weiteren Autor:innen. Die Arbeit wurde bisher 37-mal zitiert (Crossref) und nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: European Commission.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Extended reality (XR) is evolving rapidly, offering new paradigms for human-computer interaction. This position paper argues that integrating large language models (LLMs) with XR systems represents a fundamental shift toward more intelligent, context-aware, and adaptive mixed-reality experiences. We propose a structured framework built on three key pillars: first, perception and situational awareness, second, knowledge modeling and reasoning, and third, visualization and interaction. We believe leveraging LLMs within XR environments enables enhanced situational awareness, real-time knowledge retrieval, and dynamic user interaction, surpassing traditional XR capabilities. We highlight the potential of this integration in neurorehabilitation, safety training, and architectural design while underscoring ethical considerations, such as privacy, transparency, and inclusivity. This vision aims to spark discussion and drive research toward more intelligent, human-centric XR systems.

Förderung

  • European Commission

Zitieren

APA

Afzal, M. Z., Ali, S. A., Stricker, D., Eisert, P., Hilsmann, A., Perez-Marcos, D., Bianchi, M., Crottaz-Herbette, S., De Ioris, R., Mangina, E., Sanguineti, M., Salaberria, A., de Lacalle, O. L., Garcia-Pablos, A., & Cuadros, M. (2025). Next Generation XR Systems—Large Language Models Meet Augmented and Virtual Reality. IEEE Computer Graphics and Applications, 45(1), 43-55. https://doi.org/10.1109/mcg.2025.3548554

Vancouver

Afzal MZ, Ali SA, Stricker D, Eisert P, Hilsmann A, Perez-Marcos D, et al. Next Generation XR Systems—Large Language Models Meet Augmented and Virtual Reality. IEEE Computer Graphics and Applications. 2025;45(1):43-55. doi:10.1109/mcg.2025.3548554

BibTeX
@article{Afzal2025,
  author = {Afzal, Muhamamd Zeshan and Ali, Sk Aziz and Stricker, Didier and Eisert, Peter and Hilsmann, Anna and Perez-Marcos, Daniel and Bianchi, Marco and Crottaz-Herbette, Sonia and De Ioris, Roberto and Mangina, Eleni and Sanguineti, Mirco and Salaberria, Ander and de Lacalle, Oier Lopez and Garcia-Pablos, Aitor and Cuadros, Montse},
  title = {Next Generation XR Systems—Large Language Models Meet Augmented and Virtual Reality},
  journal = {IEEE Computer Graphics and Applications},
  year = {2025},
  volume = {45},
  number = {1},
  pages = {43--55},
  doi = {10.1109/mcg.2025.3548554}
}
Kostenlos starten →