EUVIMEDEUVIMED entdecken
Crossref

RUAL: Uncertainty-Aware Learning for Robust Multimodal Sentiment Analysis

Weijun Gao, Ziyang Zhang, Maotang Su

Computers, Materials & Continua · 2026 · 89 (1) · 1-10

DOI: 10.32604/cmc.2026.085382 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Computers, Materials & Continua, 2026. Verfasst von Weijun Gao und 2 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

: Multimodal sentiment analysis (MSA) has made significant progress in integrating heterogeneous information from text, speech, and vision. However, real-world multimodal data often suffer from modality noise, semantic inconsistency, and incomplete modality information, which can weaken cross-modal fusion and reduce the reliability of sentiment prediction. To address these challenges, this paper proposes RUAL, a robust uncertainty-aware learning framework for multimodal sentiment analysis. Specifically, RUAL first employs a Gathered Multi-Head Attention Pooling (GMHA) module to aggregate intra-modal features and estimate modality uncertainty based on attention entropy. Then, an Uncertainty-Aware Cross-Modal Coupled Layer (UACCL) is introduced to dynamically regulate cross-modal residual fusion according to sample confidence, thereby reducing the negative influence of unreliable modalities on fused representations. In addition, uncertainty-weighted learning and uncertainty-guided self-distillation (UWL and U-SD) are jointly integrated through an optimization strategy to further improve training stability and generalization in complex scenarios. Experimental results on CMU-MOSI, CMU-MOSEI, and MVSA-Single demonstrate that RUAL achieves strong overall performance and maintains stable prediction results under missing-modality and Gaussian-noise conditions, validating the effectiveness and robustness of the proposed framework for multimodal sentiment analysis.

Zitieren

APA

Gao, W., Zhang, Z., & Su, M. (2026). RUAL: Uncertainty-Aware Learning for Robust Multimodal Sentiment Analysis. Computers, Materials & Continua, 89(1), 1-10. https://doi.org/10.32604/cmc.2026.085382

Vancouver

Gao W, Zhang Z, Su M. RUAL: Uncertainty-Aware Learning for Robust Multimodal Sentiment Analysis. Computers, Materials & Continua. 2026;89(1):1-10. doi:10.32604/cmc.2026.085382

BibTeX
@article{Gao2026,
  author = {Gao, Weijun and Zhang, Ziyang and Su, Maotang},
  title = {RUAL: Uncertainty-Aware Learning for Robust Multimodal Sentiment Analysis},
  journal = {Computers, Materials & Continua},
  year = {2026},
  volume = {89},
  number = {1},
  pages = {1--10},
  doi = {10.32604/cmc.2026.085382}
}
Kostenlos starten →