Advances and Challenges in Multi-Modal Emotion Recognition: A Comprehensive Investigation
Mathematical Modeling and Algorithm Application · 15.03.2026 · 9 (1) · 641-645
DOI: 10.54097/0ah5h819 ↗Kurz gefasst
Fachartikel in der Zeitschrift Mathematical Modeling and Algorithm Application, online erschienen am 15.03.2026. Verfasst von Kefan Yao. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
Multi-Modal Emotion Recognition (MER) combines information from two or more modalities—such as speech, facial expressions, video, and physiological signals—to more accurately infer people’s emotional states. Previous work shows that relying on a single modality often misses important cues: for instance, audio may capture tone but not facial micro-expressions, video may capture expression but not internal arousal. Recent systems using CNNs, Transformers, or hybrid fusion architectures, applied in driving-safety and healthcare contexts, have improved accuracy significantly, especially when handling missing or noisy modalities. This survey reviews such methods, discusses current challenges like interpretability, modality mismatch, and real-time deployment, and suggests future directions including lightweight models, privacy-preserving fusion, and cross-domain generalization. Furthermore, it highlights the growing importance of explainable and adaptive models that can dynamically adjust to changing environments and user contexts. As MER continues to evolve, these innovations will enhance emotion-aware applications in human-computer interaction, mental health, and intelligent systems.
Zitieren
APA
Yao, K. (2026). Advances and Challenges in Multi-Modal Emotion Recognition: A Comprehensive Investigation. Mathematical Modeling and Algorithm Application, 9(1), 641-645. https://doi.org/10.54097/0ah5h819
Vancouver
Yao K. Advances and Challenges in Multi-Modal Emotion Recognition: A Comprehensive Investigation. Mathematical Modeling and Algorithm Application. 2026;9(1):641-645. doi:10.54097/0ah5h819
BibTeX
@article{Yao2026,
author = {Yao, Kefan},
title = {Advances and Challenges in Multi-Modal Emotion Recognition: A Comprehensive Investigation},
journal = {Mathematical Modeling and Algorithm Application},
year = {2026},
volume = {9},
number = {1},
pages = {641--645},
doi = {10.54097/0ah5h819}
}
EUVIMED