Multi-Modal Fake News Detection via Bridging the Gap between Modals
Entropy · 04.04.2023 · 25 (4) · 614
DOI: 10.3390/e25040614 ↗Kurz gefasst
Fachartikel in der Zeitschrift Entropy, online erschienen am 04.04.2023. Verfasst von Peng Liu und 4 weiteren Autor:innen. Beteiligte Einrichtung: School of Information Science and Engineering Yunnan University, Kunming 650500, China. Die Arbeit wurde bisher 25-mal zitiert (Crossref) und nennt 59 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Research Foundation of Yunnan Province, National Natural Science Foundation of China, Provincial Foundation for Leaders of Disciplines in Science and Technology.
Abstract (Originalsprache)
Multi-modal fake news detection aims to identify fake information through text and corresponding images. The current methods purely combine images and text scenarios by a vanilla attention module but there exists a semantic gap between different scenarios. To address this issue, we introduce an image caption-based method to enhance the model’s ability to capture semantic information from images. Formally, we integrate image description information into the text to bridge the semantic gap between text and images. Moreover, to optimize image utilization and enhance the semantic interaction between images and text, we combine global and object features from the images for the final representation. Finally, we leverage a transformer to fuse the above multi-modal content. We carried out extensive experiments on two publicly available datasets, and the results show that our proposed method significantly improves performance compared to other existing methods.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Information Science and Engineering Yunnan University, Kunming 650500, China.
- School of Mathematics, Southeast University, Nanjing 210096, China.
- Yonsei Frontier Lab., Yonsei University, Seoul 03722, Republic of Korea.
ORCID-Profile: Jinde Cao
Förderung
- Research Foundation of Yunnan Province
- National Natural Science Foundation of China
- Provincial Foundation for Leaders of Disciplines in Science and Technology
Zitieren
APA
Liu, P., Qian, W., Xu, D., Ren, B., & Cao, J. (2023). Multi-Modal Fake News Detection via Bridging the Gap between Modals. Entropy, 25(4), 614. https://doi.org/10.3390/e25040614
Vancouver
Liu P, Qian W, Xu D, Ren B, Cao J. Multi-Modal Fake News Detection via Bridging the Gap between Modals. Entropy. 2023;25(4):614. doi:10.3390/e25040614
BibTeX
@article{Liu2023,
author = {Liu, Peng and Qian, Wenhua and Xu, Dan and Ren, Bingling and Cao, Jinde},
title = {Multi-Modal Fake News Detection via Bridging the Gap between Modals},
journal = {Entropy},
year = {2023},
volume = {25},
number = {4},
pages = {614},
doi = {10.3390/e25040614}
}
EUVIMED