Research on Learning Concentration Recognition with Multi-Modal Features in Virtual Reality Environments
Sustainability · 27.07.2023 · 15 (15) · 11606
DOI: 10.3390/su151511606 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sustainability, online erschienen am 27.07.2023. Verfasst von Renhe Hu und 3 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 61 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Zhejiang Office of Education Sciences Planning.
Abstract (Originalsprache)
Learning concentration, as a crucial factor influencing learning outcomes, provides the basis for learners’ self-regulation and teachers’ instructional adjustments and intervention decisions. However, the current research on learning concentration recognition lacks the integration of cognitive, emotional, and behavioral features, and the integration of interaction and vision data for recognition requires further exploration. The way data are collected in a head-mounted display differs from that in a traditional classroom or online learning. Therefore, it is vital to explore a recognition method for learning concentration based on multi-modal features in VR environments. This study proposes a multi-modal feature integration-based learning concentration recognition method in VR environments. It combines interaction and vision data, including measurements of interactive tests, text, clickstream, pupil facial expressions, and eye gaze data, to measure learners’ concentration in VR environments in terms of cognitive, emotional, and behavioral representation. The experimental results demonstrate that the proposed method, which integrates interaction and vision data to comprehensively represent the cognitive, emotional, and behavioral dimensions of learning concentration, outperforms single-dimensional and single-type recognition results in terms of accuracy. Additionally, it was found that learners with higher concentration levels achieve better learning outcomes, and learners’ perceived sense of immersion is an important factor influencing their concentration.
Förderung
- Zhejiang Office of Education Sciences Planning
Zitieren
APA
Hu, R., Hui, Z., Li, Y., & Guan, J. (2023). Research on Learning Concentration Recognition with Multi-Modal Features in Virtual Reality Environments. Sustainability, 15(15), 11606. https://doi.org/10.3390/su151511606
Vancouver
Hu R, Hui Z, Li Y, Guan J. Research on Learning Concentration Recognition with Multi-Modal Features in Virtual Reality Environments. Sustainability. 2023;15(15):11606. doi:10.3390/su151511606
BibTeX
@article{Hu2023,
author = {Hu, Renhe and Hui, Zihan and Li, Yifan and Guan, Jueqi},
title = {Research on Learning Concentration Recognition with Multi-Modal Features in Virtual Reality Environments},
journal = {Sustainability},
year = {2023},
volume = {15},
number = {15},
pages = {11606},
doi = {10.3390/su151511606}
}
EUVIMED