EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Advances and Challenges in Multi-Modal Emotion Recognition: A Comprehensive Investigation

Kefan Yao

Mathematical Modeling and Algorithm Application · 15.03.2026 · 9 (1) · 641-645

DOI: 10.54097/0ah5h819 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Mathematical Modeling and Algorithm Application, online erschienen am 15.03.2026. Verfasst von Kefan Yao. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multi-Modal Emotion Recognition (MER) combines information from two or more modalities—such as speech, facial expressions, video, and physiological signals—to more accurately infer people’s emotional states. Previous work shows that relying on a single modality often misses important cues: for instance, audio may capture tone but not facial micro-expressions, video may capture expression but not internal arousal. Recent systems using CNNs, Transformers, or hybrid fusion architectures, applied in driving-safety and healthcare contexts, have improved accuracy significantly, especially when handling missing or noisy modalities. This survey reviews such methods, discusses current challenges like interpretability, modality mismatch, and real-time deployment, and suggests future directions including lightweight models, privacy-preserving fusion, and cross-domain generalization. Furthermore, it highlights the growing importance of explainable and adaptive models that can dynamically adjust to changing environments and user contexts. As MER continues to evolve, these innovations will enhance emotion-aware applications in human-computer interaction, mental health, and intelligent systems.

Zitieren

APA

Yao, K. (2026). Advances and Challenges in Multi-Modal Emotion Recognition: A Comprehensive Investigation. Mathematical Modeling and Algorithm Application, 9(1), 641-645. https://doi.org/10.54097/0ah5h819

Vancouver

Yao K. Advances and Challenges in Multi-Modal Emotion Recognition: A Comprehensive Investigation. Mathematical Modeling and Algorithm Application. 2026;9(1):641-645. doi:10.54097/0ah5h819

BibTeX
@article{Yao2026,
  author = {Yao, Kefan},
  title = {Advances and Challenges in Multi-Modal Emotion Recognition: A Comprehensive Investigation},
  journal = {Mathematical Modeling and Algorithm Application},
  year = {2026},
  volume = {9},
  number = {1},
  pages = {641--645},
  doi = {10.54097/0ah5h819}
}
Kostenlos starten →