EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Research on Multimodal Sentiment Analysis Based on Bidirectional Cross-Modal Interaction and Text-Guided Fusion

Junhao Wu, Xizhong Shen

Electronics · 17.06.2026 · 15 (12) · 2685

DOI: 10.3390/electronics15122685 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Electronics, online erschienen am 17.06.2026. Verfasst von Junhao Wu und 1 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 32 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multimodal sentiment analysis (MSA) has become a key research area in artificial intelligence, aiming to predict sentiment polarity or intensity by jointly modeling text, audio, and visual information. However, traditional methods still face significant challenges due to inherent heterogeneity among modalities, semantic representation discrepancies, and insufficient cross-modal interaction. To address these issues, this paper proposes a multimodal sentiment classification model that integrates bidirectional cross-modal attention with multi-level constraint optimization. Specifically, a unified multimodal feature encoding (UMFE) module combining BiLSTM and transformer architectures is first constructed to jointly model and extract robust unimodal representations from text, audio, and visual modalities, thereby enhancing both robustness and discriminative ability. On this basis, we introduce a bidirectional cross-modal attention mechanism, which performs Query–Key attention between modalities, enabling each modality to selectively aggregate complementary information and capture cross-modal semantic dependencies. Furthermore, a cross-modal re-fusion transformer (HMRT) module treats the textual modality as dominant to guide the deep fusion of high-level semantic features after cross-modal interaction, producing a compact unified representation. Finally, a multi-task joint optimization framework with uncertainty-based adaptive weighting dynamically balances unimodal supervision loss, cross-modal consistency loss, and sentiment classification loss, which helps improve representation learning and generalization ability.

Zitieren

APA

Wu, J., & Shen, X. (2026). Research on Multimodal Sentiment Analysis Based on Bidirectional Cross-Modal Interaction and Text-Guided Fusion. Electronics, 15(12), 2685. https://doi.org/10.3390/electronics15122685

Vancouver

Wu J, Shen X. Research on Multimodal Sentiment Analysis Based on Bidirectional Cross-Modal Interaction and Text-Guided Fusion. Electronics. 2026;15(12):2685. doi:10.3390/electronics15122685

BibTeX
@article{Wu2026,
  author = {Wu, Junhao and Shen, Xizhong},
  title = {Research on Multimodal Sentiment Analysis Based on Bidirectional Cross-Modal Interaction and Text-Guided Fusion},
  journal = {Electronics},
  year = {2026},
  volume = {15},
  number = {12},
  pages = {2685},
  doi = {10.3390/electronics15122685}
}
Kostenlos starten →