EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Multimodal Fusion with Dual-Attention Based on Textual Double-Embedding Networks for Rumor Detection

Huawei Han, Zunwang Ke, Xiangyang Nie, Li Dai, Wushour Slamu

Applied Sciences · 13.04.2023 · 13 (8) · 4886

DOI: 10.3390/app13084886 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 13.04.2023. Verfasst von Huawei Han und 4 weiteren Autor:innen. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Rumors may bring a negative impact on social life, and compared with pure textual rumors, online rumors with multiple modalities at the same time are more likely to mislead users and spread, so multimodal rumor detection cannot be ignored. Current detection methods for multimodal rumors do not focus on the fusion of text and picture-region object features, so we propose a multimodal fusion neural network TDEDA (dual-attention based on textual double embedding) applied to rumor detection, which performs a high-level information interaction at the text–image object level and captures visual features associated with keywords using an attention mechanism. In this way, we explored the ability to enhance feature representation with assistance from different modalities in rumor detection, as well as to capture the correlations of the dense interaction between images and text. We conducted comparative experiments on two multimodal rumor detection datasets. The experimental results showed that TDEDA could reasonably handle multimodal information and thus improve the accuracy of rumor detection compared with currently relevant multimodal rumor detection methods.

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Han, H., Ke, Z., Nie, X., Dai, L., & Slamu, W. (2023). Multimodal Fusion with Dual-Attention Based on Textual Double-Embedding Networks for Rumor Detection. Applied Sciences, 13(8), 4886. https://doi.org/10.3390/app13084886

Vancouver

Han H, Ke Z, Nie X, Dai L, Slamu W. Multimodal Fusion with Dual-Attention Based on Textual Double-Embedding Networks for Rumor Detection. Applied Sciences. 2023;13(8):4886. doi:10.3390/app13084886

BibTeX
@article{Han2023,
  author = {Han, Huawei and Ke, Zunwang and Nie, Xiangyang and Dai, Li and Slamu, Wushour},
  title = {Multimodal Fusion with Dual-Attention Based on Textual Double-Embedding Networks for Rumor Detection},
  journal = {Applied Sciences},
  year = {2023},
  volume = {13},
  number = {8},
  pages = {4886},
  doi = {10.3390/app13084886}
}
Kostenlos starten →