EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Natural Interaction in Virtual Heritage: Enhancing User Experience with Large Language Models

Isabel Sánchez-Berriel, Fernando Pérez-Nava, Lucas Pérez-Rosario

Electronics · 18.06.2025 · 14 (12) · 2478

DOI: 10.3390/electronics14122478 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Electronics, online erschienen am 18.06.2025. Verfasst von Isabel Sánchez-Berriel und 2 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 51 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In recent years, Virtual Reality (VR) has emerged as a powerful tool for disseminating Cultural Heritage (CH), often incorporating Virtual Humans (VHs) to guide users through historical recreations. The advent of Large Language Models (LLMs) now enables natural, unscripted communication with these VHs, even on limited devices. This paper details a natural interaction system for VHs within a VR application of San Cristóbal de La Laguna, a UNESCO World Heritage Site. Our system integrates Speech-to-Text, LLM-based dialogue generation, and Text-to-Speech synthesis. Adhering to user-centered design (UCD) principles, we conducted two studies: a preliminary study revealing user interest in historically adapted language, and a qualitative test that identified key user experience improvements, such as incorporating feedback mechanisms and gender selection for VHs. The project successfully developed a prioritized user experience, focusing on usability evaluation, immersion, and dialogue quality. We propose a generalist methodology and recommendations for integrating unscripted VH dialogue in VR. However, limitations include dialogue generation latency and reduced quality in non-English languages. While a formative usability test evaluated the process, the small sample size restricts broad generalizations about user behavior.

Zitieren

APA

Sánchez-Berriel, I., Pérez-Nava, F., & Pérez-Rosario, L. (2025). Natural Interaction in Virtual Heritage: Enhancing User Experience with Large Language Models. Electronics, 14(12), 2478. https://doi.org/10.3390/electronics14122478

Vancouver

Sánchez-Berriel I, Pérez-Nava F, Pérez-Rosario L. Natural Interaction in Virtual Heritage: Enhancing User Experience with Large Language Models. Electronics. 2025;14(12):2478. doi:10.3390/electronics14122478

BibTeX
@article{SnchezBerriel2025,
  author = {Sánchez-Berriel, Isabel and Pérez-Nava, Fernando and Pérez-Rosario, Lucas},
  title = {Natural Interaction in Virtual Heritage: Enhancing User Experience with Large Language Models},
  journal = {Electronics},
  year = {2025},
  volume = {14},
  number = {12},
  pages = {2478},
  doi = {10.3390/electronics14122478}
}
Kostenlos starten →