EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Multimodal Emotion Recognition Based on Graph Neural Networks

Zhongwen Tu, Raoxin Yan, Sihan Weng, Jiatong Li, Wei Zhao

Applied Sciences · 01.09.2025 · 15 (17) · 9622

DOI: 10.3390/app15179622 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 01.09.2025. Verfasst von Zhongwen Tu und 4 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Emotion recognition remains a challenging task in human–computer interaction. With advancements in multimodal computing, multimodal emotion recognition has become increasingly important and significant. To address the existing limitations in multimodal fusion efficiency, emotional–semantic association mining, and long-range context modeling, we propose an innovative graph neural network (GNN)-based framework. Our methodology integrates three key components: (1) a hierarchical sequential fusion (HSF) multimodal integration approach, (2) a sentiment–emotion enhanced joint learning framework, and (3) a context-similarity dual-layer graph architecture (CS-BiGraph). The experimental results demonstrate that our method achieves 69.1% accuracy on the IEMOCAP dataset, establishing a new state-of-the-art performance. For future work, we will explore robust extensions of our framework under real-world scenarios with higher noise levels and investigate the integration of emerging modalities for broader applicability.

Zitieren

APA

Tu, Z., Yan, R., Weng, S., Li, J., & Zhao, W. (2025). Multimodal Emotion Recognition Based on Graph Neural Networks. Applied Sciences, 15(17), 9622. https://doi.org/10.3390/app15179622

Vancouver

Tu Z, Yan R, Weng S, Li J, Zhao W. Multimodal Emotion Recognition Based on Graph Neural Networks. Applied Sciences. 2025;15(17):9622. doi:10.3390/app15179622

BibTeX
@article{Tu2025,
  author = {Tu, Zhongwen and Yan, Raoxin and Weng, Sihan and Li, Jiatong and Zhao, Wei},
  title = {Multimodal Emotion Recognition Based on Graph Neural Networks},
  journal = {Applied Sciences},
  year = {2025},
  volume = {15},
  number = {17},
  pages = {9622},
  doi = {10.3390/app15179622}
}
Kostenlos starten →