Hidden state-based fusion network for multimodal sentiment analysis
The Computer Journal · 15.11.2026 · 69 (11) · 1842-1854
DOI: 10.1093/comjnl/bxag062 ↗Kurz gefasst
Fachartikel in der Zeitschrift The Computer Journal, online erschienen am 22.06.2026. Verfasst von Yifan Gao und 8 weiteren Autor:innen. Die Arbeit nennt 41 Literaturangaben. Gefördert von: SIP Leadership Talent Program, Jiangsu Provincial Scheme Double Initiative Plan, XJTLU RDF.
Abstract (Originalsprache)
Multimodal sentiment analysis (MSA has gained attention for its capacity to overcome the limitations of unimodal approaches by integrating multiple modalities. We propose a hidden state-based fusion model with a gating mechanism for efficient multimodal feature integration. The proposed model achieves strong performance on the CMU-Multimodal Opinionlevel Sentiment Intensity(CMU-MOSI), CMU Multimodal Opinion Sentiment and Emotion Intensity(CMU-MOSEI), and Chinese Multimodal Sentiment Analysis(CH-SIMS) datasets while maintaining favorable parameter efficiency. By operating on hidden states and using an extensible gating design, the framework supports additional modalities with controlled computational cost. Experimental results demonstrate its effectiveness in improving prediction performance, generalization, and resource efficiency. These findings highlight the value of optimized fusion architectures for MSA.
Förderung
- SIP Leadership Talent Program
- Jiangsu Provincial Scheme Double Initiative Plan
- XJTLU RDF
- Suzhou Industrial Park Interdisciplinary Innovation (Research) Platform for Affective Computing and Interactive Health
Zitieren
APA
Gao, Y., Pan, Y., Li, Z., Liang, S., Wu, D., Zhang, C., Xu, Y., Huang, X., & Xu, Z. (2026). Hidden state-based fusion network for multimodal sentiment analysis. The Computer Journal, 69(11), 1842-1854. https://doi.org/10.1093/comjnl/bxag062
Vancouver
Gao Y, Pan Y, Li Z, Liang S, Wu D, Zhang C, et al. Hidden state-based fusion network for multimodal sentiment analysis. The Computer Journal. 2026;69(11):1842-1854. doi:10.1093/comjnl/bxag062
BibTeX
@article{Gao2026,
author = {Gao, Yifan and Pan, Yushan and Li, Zuhe and Liang, Shan and Wu, Di and Zhang, Chaolong and Xu, Yuanping and Huang, Xiaowei and Xu, Zhijie},
title = {Hidden state-based fusion network for multimodal sentiment analysis},
journal = {The Computer Journal},
year = {2026},
volume = {69},
number = {11},
pages = {1842--1854},
doi = {10.1093/comjnl/bxag062}
}
EUVIMED