EUVIMEDEUVIMED entdecken
Crossref

A Multi-Focus-Driven Multi-Branch Network for Robust Multimodal Sentiment Analysis

Chuanqi Tao, Jiaming Li, Tianzi Zang, Peng Gao

Proceedings of the AAAI Conference on Artificial Intelligence · 11.04.2025 · 39 (2) · 1547-1555

DOI: 10.1609/aaai.v39i2.32146 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 11.04.2025. Verfasst von Chuanqi Tao und 3 weiteren Autor:innen. Die Arbeit wurde bisher 16-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multimodal sentiment analysis aims to integrate diverse modalities for precise emotional interpretation. However, external factors such as sensor malfunctions or network issues may disrupt certain modalities. This may lead to missing data, which poses challenges in real-world deployment. Most existing approaches focus on designing feature reconstruction strategies, overlooking the collaborative integration of reconstruction and fusion strategies. Moreover, they fail to capture the relationships between features in the global dimension and those in the local dimension. These limitations hinder the full capture of the complex nature of multimodal data, especially in scenarios involving missing modalities. To address the above issues, this paper proposes a robust model named MFMB-Net with multiple branches for feature multi-focus fusion and reconstruction. We design a two-stream fusion branch where macro-fusion focuses on the fusion of features in the global dimension and micro-fusion targets local dimension features. This dual-stream fusion branch distributes multi-focus across both pathways, simultaneously capturing global coarse-grained and local fine-grained features. Additionally, the reconstruction branch interacts collaboratively with the fusion branch to reconstruct and enhance the missing data. It integrates the reconstructed feature information with the fused information thus refining the representation fidelity of the missing information. Experiments performed on two benchmarks show that our approach obtains results superior to state-of-the-art models.

Zitieren

APA

Tao, C., Li, J., Zang, T., & Gao, P. (2025). A Multi-Focus-Driven Multi-Branch Network for Robust Multimodal Sentiment Analysis. Proceedings of the AAAI Conference on Artificial Intelligence, 39(2), 1547-1555. https://doi.org/10.1609/aaai.v39i2.32146

Vancouver

Tao C, Li J, Zang T, Gao P. A Multi-Focus-Driven Multi-Branch Network for Robust Multimodal Sentiment Analysis. Proceedings of the AAAI Conference on Artificial Intelligence. 2025;39(2):1547-1555. doi:10.1609/aaai.v39i2.32146

BibTeX
@article{Tao2025,
  author = {Tao, Chuanqi and Li, Jiaming and Zang, Tianzi and Gao, Peng},
  title = {A Multi-Focus-Driven Multi-Branch Network for Robust Multimodal Sentiment Analysis},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2025},
  volume = {39},
  number = {2},
  pages = {1547--1555},
  doi = {10.1609/aaai.v39i2.32146}
}
Kostenlos starten →