EUVIMEDEUVIMED entdecken
Crossref

Hidden state-based fusion network for multimodal sentiment analysis

Yifan Gao, Yushan Pan, Zuhe Li, Shan Liang, Di Wu, Chaolong Zhang, Yuanping Xu, Xiaowei Huang, Zhijie Xu

The Computer Journal · 15.11.2026 · 69 (11) · 1842-1854

DOI: 10.1093/comjnl/bxag062 ↗

Kurz gefasst

Fachartikel in der Zeitschrift The Computer Journal, online erschienen am 22.06.2026. Verfasst von Yifan Gao und 8 weiteren Autor:innen. Die Arbeit nennt 41 Literaturangaben. Gefördert von: SIP Leadership Talent Program, Jiangsu Provincial Scheme Double Initiative Plan, XJTLU RDF.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multimodal sentiment analysis (MSA has gained attention for its capacity to overcome the limitations of unimodal approaches by integrating multiple modalities. We propose a hidden state-based fusion model with a gating mechanism for efficient multimodal feature integration. The proposed model achieves strong performance on the CMU-Multimodal Opinionlevel Sentiment Intensity(CMU-MOSI), CMU Multimodal Opinion Sentiment and Emotion Intensity(CMU-MOSEI), and Chinese Multimodal Sentiment Analysis(CH-SIMS) datasets while maintaining favorable parameter efficiency. By operating on hidden states and using an extensible gating design, the framework supports additional modalities with controlled computational cost. Experimental results demonstrate its effectiveness in improving prediction performance, generalization, and resource efficiency. These findings highlight the value of optimized fusion architectures for MSA.

Förderung

  • SIP Leadership Talent Program
  • Jiangsu Provincial Scheme Double Initiative Plan
  • XJTLU RDF
  • Suzhou Industrial Park Interdisciplinary Innovation (Research) Platform for Affective Computing and Interactive Health

Zitieren

APA

Gao, Y., Pan, Y., Li, Z., Liang, S., Wu, D., Zhang, C., Xu, Y., Huang, X., & Xu, Z. (2026). Hidden state-based fusion network for multimodal sentiment analysis. The Computer Journal, 69(11), 1842-1854. https://doi.org/10.1093/comjnl/bxag062

Vancouver

Gao Y, Pan Y, Li Z, Liang S, Wu D, Zhang C, et al. Hidden state-based fusion network for multimodal sentiment analysis. The Computer Journal. 2026;69(11):1842-1854. doi:10.1093/comjnl/bxag062

BibTeX
@article{Gao2026,
  author = {Gao, Yifan and Pan, Yushan and Li, Zuhe and Liang, Shan and Wu, Di and Zhang, Chaolong and Xu, Yuanping and Huang, Xiaowei and Xu, Zhijie},
  title = {Hidden state-based fusion network for multimodal sentiment analysis},
  journal = {The Computer Journal},
  year = {2026},
  volume = {69},
  number = {11},
  pages = {1842--1854},
  doi = {10.1093/comjnl/bxag062}
}
Kostenlos starten →