Modality-Enhanced Multimodal Integrated Fusion Attention Model for Sentiment Analysis
Applied Sciences · 09.10.2025 · 15 (19) · 10825
DOI: 10.3390/app151910825 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 09.10.2025. Verfasst von Zhenwei Zhang und 3 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 26 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
Multimodal sentiment analysis aims to utilize multisource information such as text, speech and vision to more comprehensively and accurately identify an individual’s emotional state. However, existing methods still face challenges in practical applications, including modality heterogeneity, insufficient expressive power of non-verbal modalities, and low fusion efficiency. To address these issues, this paper proposes a Modality Enhanced Multimodal Integration Model (MEMMI). First, a modality enhancement module is designed to leverage the semantic guidance capability of the text modality, enhancing the feature representation of non-verbal modalities through a multihead attention mechanism and a dynamic routing strategy. Second, a gated fusion mechanism is introduced to selectively inject speech and visual information into the dominant text modality, enabling robust information completion and noise suppression. Finally, a combined attention fusion module is constructed to synchronously fuse information from all three modalities within a unified architecture, hile a multiscale encoder is used to capture feature representations at different semantic levels. Experimental results on three benchmark datasets—CMU-MOSEI, CMU-MOSI, and CH-SIMS—demonstrate the superiority of the proposed model. On CMU-MOSI, it achieves an Acc-7 of 45.91, with binary accuracy/F1 of 82.86/84.60, MAE of 0.734, and Corr of 0.790, outperforming TFN and MulT by a large margin. On CMU-MOSEI, the model reaches an Acc-7 of 54.17, Acc-2/F1 of 83.69/86.02, MAE of 0.526, and Corr of 0.779, surpassing all baselines, including ALMT. On CH-SIMS, it further achieves 41.88, 66.52, and 77.68 in Acc-5/Acc-3/Acc-2, with F1 of 77.85, MAE of 0.450, and Corr of 0.594, establishing new state-of-the-art performance across datasets. These results confirm that MEMMI achieves state-of-the-art performance across multiple metrics. Furthermore, ablation studies validate the effectiveness of each module in enhancing modality representation and fusion efficiency.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Zhang, Z., Wu, W., Yuan, T., & Feng, G. (2025). Modality-Enhanced Multimodal Integrated Fusion Attention Model for Sentiment Analysis. Applied Sciences, 15(19), 10825. https://doi.org/10.3390/app151910825
Vancouver
Zhang Z, Wu W, Yuan T, Feng G. Modality-Enhanced Multimodal Integrated Fusion Attention Model for Sentiment Analysis. Applied Sciences. 2025;15(19):10825. doi:10.3390/app151910825
BibTeX
@article{Zhang2025,
author = {Zhang, Zhenwei and Wu, Wenyan and Yuan, Tao and Feng, Guang},
title = {Modality-Enhanced Multimodal Integrated Fusion Attention Model for Sentiment Analysis},
journal = {Applied Sciences},
year = {2025},
volume = {15},
number = {19},
pages = {10825},
doi = {10.3390/app151910825}
}
EUVIMED