Natural Interaction in Virtual Heritage: Enhancing User Experience with Large Language Models
Electronics · 18.06.2025 · 14 (12) · 2478
DOI: 10.3390/electronics14122478 ↗Kurz gefasst
Fachartikel in der Zeitschrift Electronics, online erschienen am 18.06.2025. Verfasst von Isabel Sánchez-Berriel und 2 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 51 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
In recent years, Virtual Reality (VR) has emerged as a powerful tool for disseminating Cultural Heritage (CH), often incorporating Virtual Humans (VHs) to guide users through historical recreations. The advent of Large Language Models (LLMs) now enables natural, unscripted communication with these VHs, even on limited devices. This paper details a natural interaction system for VHs within a VR application of San Cristóbal de La Laguna, a UNESCO World Heritage Site. Our system integrates Speech-to-Text, LLM-based dialogue generation, and Text-to-Speech synthesis. Adhering to user-centered design (UCD) principles, we conducted two studies: a preliminary study revealing user interest in historically adapted language, and a qualitative test that identified key user experience improvements, such as incorporating feedback mechanisms and gender selection for VHs. The project successfully developed a prioritized user experience, focusing on usability evaluation, immersion, and dialogue quality. We propose a generalist methodology and recommendations for integrating unscripted VH dialogue in VR. However, limitations include dialogue generation latency and reduced quality in non-English languages. While a formative usability test evaluated the process, the small sample size restricts broad generalizations about user behavior.
Zitieren
APA
Sánchez-Berriel, I., Pérez-Nava, F., & Pérez-Rosario, L. (2025). Natural Interaction in Virtual Heritage: Enhancing User Experience with Large Language Models. Electronics, 14(12), 2478. https://doi.org/10.3390/electronics14122478
Vancouver
Sánchez-Berriel I, Pérez-Nava F, Pérez-Rosario L. Natural Interaction in Virtual Heritage: Enhancing User Experience with Large Language Models. Electronics. 2025;14(12):2478. doi:10.3390/electronics14122478
BibTeX
@article{SnchezBerriel2025,
author = {Sánchez-Berriel, Isabel and Pérez-Nava, Fernando and Pérez-Rosario, Lucas},
title = {Natural Interaction in Virtual Heritage: Enhancing User Experience with Large Language Models},
journal = {Electronics},
year = {2025},
volume = {14},
number = {12},
pages = {2478},
doi = {10.3390/electronics14122478}
}
EUVIMED