Enhancing handicraft intangible cultural heritage learning through immersive VR serious games: a multimodal study on natural interaction effectiveness
Frontiers in Psychology · 16.07.2026 · 17
DOI: 10.3389/fpsyg.2026.1880795 ↗Kurz gefasst
Fachartikel in der Zeitschrift Frontiers in Psychology, online erschienen am 16.07.2026. Verfasst von Yupeng Jiang und 1 weiteren Autor:innen. Beteiligte Einrichtung: School of Mechanical Engineering, Northwestern Polytechnical University, Xi'an, China. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 91 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Introduction
With the integration of natural interaction technologies such as gesture recognition and eye tracking into virtual reality (VR) systems, new possibilities have emerged for VR-based education of intangible cultural heritage (ICH) craftsmanship. Using Bai ethnic tie-dyeing as a case, this study developed an immersive virtual reality serious game (IVR-SG) grounded in Self-Determination Theory (SDT) to explore the differences between natural and controller-based interaction in VR learning of handicraft ICH.
Methods
A total of 68 participants were randomly assigned to a natural interaction group or a controller interaction group. Learning processes were assessed through eye-tracking, electrodermal activity (EDA) and questionnaires.
Results
The results revealed three key findings. First, participants using natural interaction demonstrated higher attentional focus during craft process simulation and faster command selection, but exhibited higher cognitive loads in precision tasks. Second, the natural interaction group reported significantly higher flow experience and self-efficacy. Third, the natural interaction group achieved significantly higher post-test knowledge scores, while both groups achieved comparable in-game procedural performance. Furthermore, regression analysis indicated that prior knowledge, flow experience, self-efficacy, and blink rates were positively correlated with knowledge acquisition.
Discussion
These findings highlight the differential impacts of interaction modalities in VR-based handicraft ICH education and provide design references for optimizing natural interaction in VR serious games for ICH.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Mechanical Engineering, Northwestern Polytechnical University, Xi'an, China.
- Key Laboratory of Ministry of Industrial Design and Ergonomics, Ministry of Industry and Information Technology, Northwestern Polytechnical University, Xi'an, China.
- Shaanxi Engineering Laboratory for Industrial Design, Northwestern Polytechnical University, Xi'an, China.
Zitieren
APA
Jiang, Y., & Gou, B. (2026). Enhancing handicraft intangible cultural heritage learning through immersive VR serious games: a multimodal study on natural interaction effectiveness. Frontiers in Psychology, 17. https://doi.org/10.3389/fpsyg.2026.1880795
Vancouver
Jiang Y, Gou B. Enhancing handicraft intangible cultural heritage learning through immersive VR serious games: a multimodal study on natural interaction effectiveness. Frontiers in Psychology. 2026;17. doi:10.3389/fpsyg.2026.1880795
BibTeX
@article{Jiang2026,
author = {Jiang, Yupeng and Gou, Bingchen},
title = {Enhancing handicraft intangible cultural heritage learning through immersive VR serious games: a multimodal study on natural interaction effectiveness},
journal = {Frontiers in Psychology},
year = {2026},
volume = {17},
doi = {10.3389/fpsyg.2026.1880795}
}
EUVIMED