FDC-MSA: Feature denoising and conflict decoupling for inconsistent multimodal sentiment analysis
Journal of King Saud University Computer and Information Sciences · 2026-08 · 38 (6)
DOI: 10.1007/s44443-026-00935-9 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of King Saud University Computer and Information Sciences, online erschienen am 16.06.2026. Verfasst von Na Su und 4 weiteren Autor:innen. Die Arbeit nennt 54 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
Multimodal Sentiment Analysis (MSA) aims to capture complex emotions by integrating diverse modalities. However, existing methods often struggle to distinguish cross-modal consensus from conflicts, while facing challenges from redundant noise and feature manifold distortion. To address these issues, we propose FDC-MSA, a framework for noise suppression and conflict decoupling in inconsistent MSA. The model enhances sentiment modeling through three integrated components. First, a Variational Information Bottleneck (VIB) strategy is employed to compress and reconstruct auxiliary semantics. By suppressing task-irrelevant redundancy while maximizing sentiment sufficiency, it achieves semantic purification. Second, the Geometric Orthogonal Decoupling Routing (GODR) mechanism decomposes visual representations into consensus and specificity components, utilizing dynamic routing to adaptively model cross-modal conflicts. Furthermore, a Prototype-Guided Topology Rectification (PGTR) module stabilizes high-dimensional representation spaces by guiding feature distributions toward category structures. Experimental results on MVSA-Single, MVSA-Multiple, and HFM datasets demonstrate that FDC-MSA achieves state-of-the-art performance, notably reaching 78.96% accuracy on MVSA-Single. The framework exhibits superior robustness in handling text-image sentiment inconsistencies, validating the effectiveness of our denoising and decoupling strategies in complex cross-modal scenarios.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Su, N., Liu, Y., Jiang, D., Li, Y., & Ji, S. (2026). FDC-MSA: Feature denoising and conflict decoupling for inconsistent multimodal sentiment analysis. Journal of King Saud University Computer and Information Sciences, 38(6). https://doi.org/10.1007/s44443-026-00935-9
Vancouver
Su N, Liu Y, Jiang D, Li Y, Ji S. FDC-MSA: Feature denoising and conflict decoupling for inconsistent multimodal sentiment analysis. Journal of King Saud University Computer and Information Sciences. 2026;38(6). doi:10.1007/s44443-026-00935-9
BibTeX
@article{Su2026,
author = {Su, Na and Liu, YiMing and Jiang, DeHao and Li, YiQun and Ji, ShuJuan},
title = {FDC-MSA: Feature denoising and conflict decoupling for inconsistent multimodal sentiment analysis},
journal = {Journal of King Saud University Computer and Information Sciences},
year = {2026},
volume = {38},
number = {6},
doi = {10.1007/s44443-026-00935-9}
}
EUVIMED