Reward-Guided Dynamic Fusion and Modality Decoupling for Enhanced Multimodal Sentiment Analysis
Electronics · 24.04.2026 · 15 (9) · 1813
DOI: 10.3390/electronics15091813 ↗Kurz gefasst
Fachartikel in der Zeitschrift Electronics, online erschienen am 24.04.2026. Verfasst von He Zhang und 6 weiteren Autor:innen. Die Arbeit nennt 32 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Key Research and Development Program of China, National Natural Science Foundation of China, Key Research and Development Program of Shaanxi Province.
Abstract (Originalsprache)
Multimodal Sentiment Analysis (MSA) integrates multiple modalities to better understand human emotions. However, existing methods often neglect heterogeneity among modal features, causing redundancy and inconsistencies. Additionally, the dynamic interplay between modalities is frequently ignored during fusion, limiting performance. To address these issues, we propose Reward-Guided Dynamic Fusion and Modality Decoupling (RDFD). RDFD includes two key components: (1) a feature decoupling module that separates modality-specific and modality-shared features, reducing redundancy and conflicts; (2) a Reward-Guided Dynamic Fusion module that adaptively selects guiding modalities to enhance modality-specific representations and enable flexible fusion. Experiments on the CMU-MOSI and CMU-MOSEI datasets show that RDFD achieves state-of-the-art performance, demonstrating its effectiveness in advancing Multimodal Sentiment Analysis.
Förderung
- National Key Research and Development Program of China
- National Natural Science Foundation of China
- Key Research and Development Program of Shaanxi Province
- Xi’an Social Sciences Planning Fund Project
- Humanities and Social Sciences Research Project of the Shaanxi Provincial Department of Education
Zitieren
APA
Zhang, H., Gao, Z., Yan, Q., Gu, Y., Wang, S., Liu, L., & An, D. (2026). Reward-Guided Dynamic Fusion and Modality Decoupling for Enhanced Multimodal Sentiment Analysis. Electronics, 15(9), 1813. https://doi.org/10.3390/electronics15091813
Vancouver
Zhang H, Gao Z, Yan Q, Gu Y, Wang S, Liu L, et al. Reward-Guided Dynamic Fusion and Modality Decoupling for Enhanced Multimodal Sentiment Analysis. Electronics. 2026;15(9):1813. doi:10.3390/electronics15091813
BibTeX
@article{Zhang2026,
author = {Zhang, He and Gao, Zichen and Yan, Qi and Gu, Yu and Wang, Shuang and Liu, Linsong and An, Dequan},
title = {Reward-Guided Dynamic Fusion and Modality Decoupling for Enhanced Multimodal Sentiment Analysis},
journal = {Electronics},
year = {2026},
volume = {15},
number = {9},
pages = {1813},
doi = {10.3390/electronics15091813}
}
EUVIMED