EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Multi-Modal Fake News Detection via Bridging the Gap between Modals

Peng Liu, Wenhua Qian, Dan Xu, Bingling Ren, Jinde Cao iD

Entropy · 04.04.2023 · 25 (4) · 614

DOI: 10.3390/e25040614 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Entropy, online erschienen am 04.04.2023. Verfasst von Peng Liu und 4 weiteren Autor:innen. Beteiligte Einrichtung: School of Information Science and Engineering Yunnan University, Kunming 650500, China. Die Arbeit wurde bisher 25-mal zitiert (Crossref) und nennt 59 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Research Foundation of Yunnan Province, National Natural Science Foundation of China, Provincial Foundation for Leaders of Disciplines in Science and Technology.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multi-modal fake news detection aims to identify fake information through text and corresponding images. The current methods purely combine images and text scenarios by a vanilla attention module but there exists a semantic gap between different scenarios. To address this issue, we introduce an image caption-based method to enhance the model’s ability to capture semantic information from images. Formally, we integrate image description information into the text to bridge the semantic gap between text and images. Moreover, to optimize image utilization and enhance the semantic interaction between images and text, we combine global and object features from the images for the final representation. Finally, we leverage a transformer to fuse the above multi-modal content. We carried out extensive experiments on two publicly available datasets, and the results show that our proposed method significantly improves performance compared to other existing methods.

Schlagwörter

Stichwörter der Autor:innen

caption-basedfake news detectionmulti-modaltransformer

Autor:innen und Institutionen

  • School of Information Science and Engineering Yunnan University, Kunming 650500, China.
  • School of Mathematics, Southeast University, Nanjing 210096, China.
  • Yonsei Frontier Lab., Yonsei University, Seoul 03722, Republic of Korea.

ORCID-Profile: Jinde Cao

Förderung

  • Research Foundation of Yunnan Province
  • National Natural Science Foundation of China
  • Provincial Foundation for Leaders of Disciplines in Science and Technology

Zitieren

APA

Liu, P., Qian, W., Xu, D., Ren, B., & Cao, J. (2023). Multi-Modal Fake News Detection via Bridging the Gap between Modals. Entropy, 25(4), 614. https://doi.org/10.3390/e25040614

Vancouver

Liu P, Qian W, Xu D, Ren B, Cao J. Multi-Modal Fake News Detection via Bridging the Gap between Modals. Entropy. 2023;25(4):614. doi:10.3390/e25040614

BibTeX
@article{Liu2023,
  author = {Liu, Peng and Qian, Wenhua and Xu, Dan and Ren, Bingling and Cao, Jinde},
  title = {Multi-Modal Fake News Detection via Bridging the Gap between Modals},
  journal = {Entropy},
  year = {2023},
  volume = {25},
  number = {4},
  pages = {614},
  doi = {10.3390/e25040614}
}
Kostenlos starten →