EUVIMEDEUVIMED entdecken
Crossref

PSA-MF: Personality-Sentiment Aligned Multi-Level Fusion for Multimodal Sentiment Analysis

Heng Xie, Kang Zhu, Zhengqi Wen, Jianhua Tao, Xuefei Liu, Ruibo Fu, Changsheng Li

Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (3) · 2191-2199

DOI: 10.1609/aaai.v40i3.37202 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Heng Xie und 6 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multimodal sentiment analysis (MSA) is a research field that recognizes human sentiments by combining textual, visual, and audio modalities. The main challenge lies in integrating sentiment-related information from different modalities, which typically arises during the unimodal feature extraction phase and the multimodal feature fusion phase. Existing methods extract only shallow information from unimodal features during the extraction phase, neglecting sentimental differences across different personalities. During the fusion phase, they directly merge the feature information from each modality without considering differences at the feature level. This ultimately affects the model's recognition performance. To address this problem, we propose a personality-sentiment aligned multi-level fusion framework. We introduce personality traits during the feature extraction phase and propose a novel personality-sentiment alignment method to obtain personalized sentiment embeddings from the textual modality for the first time. In the fusion phase, we introduce a novel multi-level fusion method. This method gradually integrates sentimental information from textual, visual, and audio modalities through multimodal pre-fusion and a multi-level enhanced fusion strategy. Our method has been evaluated through multiple experiments on two commonly used datasets, achieving state-of-the-art results.

Zitieren

APA

Xie, H., Zhu, K., Wen, Z., Tao, J., Liu, X., Fu, R., & Li, C. (2026). PSA-MF: Personality-Sentiment Aligned Multi-Level Fusion for Multimodal Sentiment Analysis. Proceedings of the AAAI Conference on Artificial Intelligence, 40(3), 2191-2199. https://doi.org/10.1609/aaai.v40i3.37202

Vancouver

Xie H, Zhu K, Wen Z, Tao J, Liu X, Fu R, et al. PSA-MF: Personality-Sentiment Aligned Multi-Level Fusion for Multimodal Sentiment Analysis. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(3):2191-2199. doi:10.1609/aaai.v40i3.37202

BibTeX
@article{Xie2026,
  author = {Xie, Heng and Zhu, Kang and Wen, Zhengqi and Tao, Jianhua and Liu, Xuefei and Fu, Ruibo and Li, Changsheng},
  title = {PSA-MF: Personality-Sentiment Aligned Multi-Level Fusion for Multimodal Sentiment Analysis},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2026},
  volume = {40},
  number = {3},
  pages = {2191--2199},
  doi = {10.1609/aaai.v40i3.37202}
}
Kostenlos starten →