Multimodal Emotion Recognition Based on Graph Neural Networks
Applied Sciences · 01.09.2025 · 15 (17) · 9622
DOI: 10.3390/app15179622 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 01.09.2025. Verfasst von Zhongwen Tu und 4 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Emotion recognition remains a challenging task in human–computer interaction. With advancements in multimodal computing, multimodal emotion recognition has become increasingly important and significant. To address the existing limitations in multimodal fusion efficiency, emotional–semantic association mining, and long-range context modeling, we propose an innovative graph neural network (GNN)-based framework. Our methodology integrates three key components: (1) a hierarchical sequential fusion (HSF) multimodal integration approach, (2) a sentiment–emotion enhanced joint learning framework, and (3) a context-similarity dual-layer graph architecture (CS-BiGraph). The experimental results demonstrate that our method achieves 69.1% accuracy on the IEMOCAP dataset, establishing a new state-of-the-art performance. For future work, we will explore robust extensions of our framework under real-world scenarios with higher noise levels and investigate the integration of emerging modalities for broader applicability.
Zitieren
APA
Tu, Z., Yan, R., Weng, S., Li, J., & Zhao, W. (2025). Multimodal Emotion Recognition Based on Graph Neural Networks. Applied Sciences, 15(17), 9622. https://doi.org/10.3390/app15179622
Vancouver
Tu Z, Yan R, Weng S, Li J, Zhao W. Multimodal Emotion Recognition Based on Graph Neural Networks. Applied Sciences. 2025;15(17):9622. doi:10.3390/app15179622
BibTeX
@article{Tu2025,
author = {Tu, Zhongwen and Yan, Raoxin and Weng, Sihan and Li, Jiatong and Zhao, Wei},
title = {Multimodal Emotion Recognition Based on Graph Neural Networks},
journal = {Applied Sciences},
year = {2025},
volume = {15},
number = {17},
pages = {9622},
doi = {10.3390/app15179622}
}
EUVIMED