EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

FDC-MSA: Feature denoising and conflict decoupling for inconsistent multimodal sentiment analysis

Na Su, YiMing Liu, DeHao Jiang, YiQun Li, ShuJuan Ji

Journal of King Saud University Computer and Information Sciences · 2026-08 · 38 (6)

DOI: 10.1007/s44443-026-00935-9 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of King Saud University Computer and Information Sciences, online erschienen am 16.06.2026. Verfasst von Na Su und 4 weiteren Autor:innen. Die Arbeit nennt 54 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multimodal Sentiment Analysis (MSA) aims to capture complex emotions by integrating diverse modalities. However, existing methods often struggle to distinguish cross-modal consensus from conflicts, while facing challenges from redundant noise and feature manifold distortion. To address these issues, we propose FDC-MSA, a framework for noise suppression and conflict decoupling in inconsistent MSA. The model enhances sentiment modeling through three integrated components. First, a Variational Information Bottleneck (VIB) strategy is employed to compress and reconstruct auxiliary semantics. By suppressing task-irrelevant redundancy while maximizing sentiment sufficiency, it achieves semantic purification. Second, the Geometric Orthogonal Decoupling Routing (GODR) mechanism decomposes visual representations into consensus and specificity components, utilizing dynamic routing to adaptively model cross-modal conflicts. Furthermore, a Prototype-Guided Topology Rectification (PGTR) module stabilizes high-dimensional representation spaces by guiding feature distributions toward category structures. Experimental results on MVSA-Single, MVSA-Multiple, and HFM datasets demonstrate that FDC-MSA achieves state-of-the-art performance, notably reaching 78.96% accuracy on MVSA-Single. The framework exhibits superior robustness in handling text-image sentiment inconsistencies, validating the effectiveness of our denoising and decoupling strategies in complex cross-modal scenarios.

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Su, N., Liu, Y., Jiang, D., Li, Y., & Ji, S. (2026). FDC-MSA: Feature denoising and conflict decoupling for inconsistent multimodal sentiment analysis. Journal of King Saud University Computer and Information Sciences, 38(6). https://doi.org/10.1007/s44443-026-00935-9

Vancouver

Su N, Liu Y, Jiang D, Li Y, Ji S. FDC-MSA: Feature denoising and conflict decoupling for inconsistent multimodal sentiment analysis. Journal of King Saud University Computer and Information Sciences. 2026;38(6). doi:10.1007/s44443-026-00935-9

BibTeX
@article{Su2026,
  author = {Su, Na and Liu, YiMing and Jiang, DeHao and Li, YiQun and Ji, ShuJuan},
  title = {FDC-MSA: Feature denoising and conflict decoupling for inconsistent multimodal sentiment analysis},
  journal = {Journal of King Saud University Computer and Information Sciences},
  year = {2026},
  volume = {38},
  number = {6},
  doi = {10.1007/s44443-026-00935-9}
}
Kostenlos starten →