Research on Multimodal Sentiment Analysis Based on Bidirectional Cross-Modal Interaction and Text-Guided Fusion
Electronics · 17.06.2026 · 15 (12) · 2685
DOI: 10.3390/electronics15122685 ↗Kurz gefasst
Fachartikel in der Zeitschrift Electronics, online erschienen am 17.06.2026. Verfasst von Junhao Wu und 1 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 32 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Multimodal sentiment analysis (MSA) has become a key research area in artificial intelligence, aiming to predict sentiment polarity or intensity by jointly modeling text, audio, and visual information. However, traditional methods still face significant challenges due to inherent heterogeneity among modalities, semantic representation discrepancies, and insufficient cross-modal interaction. To address these issues, this paper proposes a multimodal sentiment classification model that integrates bidirectional cross-modal attention with multi-level constraint optimization. Specifically, a unified multimodal feature encoding (UMFE) module combining BiLSTM and transformer architectures is first constructed to jointly model and extract robust unimodal representations from text, audio, and visual modalities, thereby enhancing both robustness and discriminative ability. On this basis, we introduce a bidirectional cross-modal attention mechanism, which performs Query–Key attention between modalities, enabling each modality to selectively aggregate complementary information and capture cross-modal semantic dependencies. Furthermore, a cross-modal re-fusion transformer (HMRT) module treats the textual modality as dominant to guide the deep fusion of high-level semantic features after cross-modal interaction, producing a compact unified representation. Finally, a multi-task joint optimization framework with uncertainty-based adaptive weighting dynamically balances unimodal supervision loss, cross-modal consistency loss, and sentiment classification loss, which helps improve representation learning and generalization ability.
Zitieren
APA
Wu, J., & Shen, X. (2026). Research on Multimodal Sentiment Analysis Based on Bidirectional Cross-Modal Interaction and Text-Guided Fusion. Electronics, 15(12), 2685. https://doi.org/10.3390/electronics15122685
Vancouver
Wu J, Shen X. Research on Multimodal Sentiment Analysis Based on Bidirectional Cross-Modal Interaction and Text-Guided Fusion. Electronics. 2026;15(12):2685. doi:10.3390/electronics15122685
BibTeX
@article{Wu2026,
author = {Wu, Junhao and Shen, Xizhong},
title = {Research on Multimodal Sentiment Analysis Based on Bidirectional Cross-Modal Interaction and Text-Guided Fusion},
journal = {Electronics},
year = {2026},
volume = {15},
number = {12},
pages = {2685},
doi = {10.3390/electronics15122685}
}
EUVIMED