EUVIMEDEUVIMED entdecken
ÜbersichtsarbeitOpen Access · CC BY 4.0

A Comprehensive Review of Multimodal Emotion Recognition: Techniques, Challenges, and Future Directions

You Wu, Qingwei Mi iD, Tianhan Gao

Biomimetics · 27.06.2025 · 10 (7) · 418

DOI: 10.3390/biomimetics10070418 ↗

Kurz gefasst

Übersichtsarbeit in der Zeitschrift Biomimetics, online erschienen am 27.06.2025. Verfasst von You Wu und 2 weiteren Autor:innen. Beteiligte Einrichtung: Software College, Northeastern University, Shenyang 110169, China. Die Arbeit wurde bisher 130-mal zitiert (Crossref) und nennt 103 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This paper presents a comprehensive review of multimodal emotion recognition (MER), a process that integrates multiple data modalities such as speech, visual, and text to identify human emotions. Grounded in biomimetics, the survey frames MER as a bio-inspired sensing paradigm that emulates the way humans seamlessly fuse multisensory cues to communicate affect, thereby transferring principles from living systems to engineered solutions. By leveraging various modalities, MER systems offer a richer and more robust analysis of emotional states compared to unimodal approaches. The review covers the general structure of MER systems, feature extraction techniques, and multimodal information fusion strategies, highlighting key advancements and milestones. Additionally, it addresses the research challenges and open issues in MER, including lightweight models, cross-corpus generalizability, and the incorporation of additional modalities. The paper concludes by discussing future directions aimed at improving the accuracy, explainability, and practicality of MER systems for real-world applications.

Schlagwörter

Stichwörter der Autor:innen

emotion analysisfeature extractioninformation fusionmultimodal emotion recognition

Autor:innen und Institutionen

  • Software College, Northeastern University, Shenyang 110169, China.

ORCID-Profile: Qingwei Mi

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Wu, Y., Mi, Q., & Gao, T. (2025). A Comprehensive Review of Multimodal Emotion Recognition: Techniques, Challenges, and Future Directions. Biomimetics, 10(7), 418. https://doi.org/10.3390/biomimetics10070418

Vancouver

Wu Y, Mi Q, Gao T. A Comprehensive Review of Multimodal Emotion Recognition: Techniques, Challenges, and Future Directions. Biomimetics. 2025;10(7):418. doi:10.3390/biomimetics10070418

BibTeX
@article{Wu2025,
  author = {Wu, You and Mi, Qingwei and Gao, Tianhan},
  title = {A Comprehensive Review of Multimodal Emotion Recognition: Techniques, Challenges, and Future Directions},
  journal = {Biomimetics},
  year = {2025},
  volume = {10},
  number = {7},
  pages = {418},
  doi = {10.3390/biomimetics10070418}
}
Kostenlos starten →