Dynamic Emotion-Dependent Network With Relational Subgraph Interaction for Multimodal Emotion Recognition
IEEE Transactions on Affective Computing · 2025-04 · 16 (2) · 712-725
DOI: 10.1109/taffc.2024.3461148 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Affective Computing, 2025-04. Verfasst von Ye Wang und 6 weiteren Autor:innen. Die Arbeit wurde bisher 19-mal zitiert (Crossref) und nennt 46 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Science and Technology Research Program of Chongqing Municipal Education Commission, HangNao Found for Young Scholars.
Abstract (Originalsprache)
Multimodal Emotion Recognition in Conversations (MERC) is an important topic in human-computer interaction. In the MERC task, conversations exhibit dynamic emotional dependency, including inter-speaker and intra-speaker emotional dependency, both are vital in understanding the content. However, current research primarily integrates these two emotional dependencies into one unified module, limiting the accuracy of MERC. In this paper, we propose a dynamic emotion-dependent network with relational subgraph interaction named DEDNet. DEDNet introduces relational subgraphs to separately model two emotional dependencies, enabling structured learning paths for utterances based on distinct emotional dependency types. Specifically, nodes indicate the utterances at different moments in the conversation, while edges define the emotional dependency and temporal relationships between nodes. To explicitly capture the differences between these two emotional dependencies, distinct subgraphs are designed for comprehensive representations. Furthermore, we propose an incremental interactive strategy, sequentially leveraging two emotional dependencies to learn the changes in dependency relationships. We find that modeling inter-speaker emotional dependency can better identify negative emotions and modeling intra-speaker emotional dependency can better recognize positive emotions. Experimental results demonstrate that our model outperforms current state-of-the-art methods on three benchmark datasets, IEMOCAP, MELD and DailyDialog.
Förderung
- National Natural Science Foundation of China
- Science and Technology Research Program of Chongqing Municipal Education Commission
- HangNao Found for Young Scholars
Zitieren
APA
Wang, Y., Zhang, W., Liu, K., Wu, W., Hu, F., Yu, H., & Wang, G. (2025). Dynamic Emotion-Dependent Network With Relational Subgraph Interaction for Multimodal Emotion Recognition. IEEE Transactions on Affective Computing, 16(2), 712-725. https://doi.org/10.1109/taffc.2024.3461148
Vancouver
Wang Y, Zhang W, Liu K, Wu W, Hu F, Yu H, et al. Dynamic Emotion-Dependent Network With Relational Subgraph Interaction for Multimodal Emotion Recognition. IEEE Transactions on Affective Computing. 2025;16(2):712-725. doi:10.1109/taffc.2024.3461148
BibTeX
@article{Wang2025,
author = {Wang, Ye and Zhang, Wei and Liu, Ke and Wu, Wei and Hu, Feng and Yu, Hong and Wang, Guoyin},
title = {Dynamic Emotion-Dependent Network With Relational Subgraph Interaction for Multimodal Emotion Recognition},
journal = {IEEE Transactions on Affective Computing},
year = {2025},
volume = {16},
number = {2},
pages = {712--725},
doi = {10.1109/taffc.2024.3461148}
}
EUVIMED