A Review of Multimodal Interaction in Remote Education: Technologies, Applications, and Challenges
Applied Sciences · 03.04.2025 · 15 (7) · 3937
DOI: 10.3390/app15073937 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 03.04.2025. Verfasst von Yangmei Xie und 4 weiteren Autor:innen. Die Arbeit wurde bisher 24-mal zitiert (Crossref) und nennt 82 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Kobe University CMDS Joint Project Promoting DX Inside & Outside the University.
Abstract (Originalsprache)
Multimodal interaction technology has become a key aspect of remote education by enriching student engagement and learning results as it utilizes the speech, gesture, and visual feedback as various sensory channels. This publication reflects on the latest breakthroughs in multimodal interaction and its usage in remote learning environments, including a multi-layered discussion that addresses various levels of learning and understanding. It showcases the main technologies, such as speech recognition, computer vision, and haptic feedback, that enable the visitors and learning portals to exchange data fluidly. In addition, we investigate the function of multimodal learning analytics in order to measure the cognitive and emotional states of students, targeting personalized feedback and refining instructional strategies. Though multimodal communication may bring a historical improvement to the mode of online education, the platform still faces many issues, such as media synchronization, higher computational demand, physical adaptability, and privacy concerns. These problems demand further research in the fields of algorithm optimization, access to technology guidance, and the ethical use of big data. This paper presents a systematic review of the application of multimodal interaction in remote education. Through the analysis of 25 selected research papers, this review explores key technologies, applications, and challenges in the field. By synthesizing existing findings, this study highlights the role of multimodal learning analytics, speech recognition, gesture-based interaction, and haptic feedback in enhancing remote learning.
Förderung
- Kobe University CMDS Joint Project Promoting DX Inside & Outside the University
Zitieren
APA
Xie, Y., Yang, L., Zhang, M., Chen, S., & Li, J. (2025). A Review of Multimodal Interaction in Remote Education: Technologies, Applications, and Challenges. Applied Sciences, 15(7), 3937. https://doi.org/10.3390/app15073937
Vancouver
Xie Y, Yang L, Zhang M, Chen S, Li J. A Review of Multimodal Interaction in Remote Education: Technologies, Applications, and Challenges. Applied Sciences. 2025;15(7):3937. doi:10.3390/app15073937
BibTeX
@article{Xie2025,
author = {Xie, Yangmei and Yang, Liuyi and Zhang, Miao and Chen, Sinan and Li, Jialong},
title = {A Review of Multimodal Interaction in Remote Education: Technologies, Applications, and Challenges},
journal = {Applied Sciences},
year = {2025},
volume = {15},
number = {7},
pages = {3937},
doi = {10.3390/app15073937}
}
EUVIMED