Multimodal Fake News Detection with Contrastive Learning and Optimal Transport
Frontiers in Computer Science · 15.11.2024 · 6
DOI: 10.3389/fcomp.2024.1473457 ↗Kurz gefasst
Fachartikel in der Zeitschrift Frontiers in Computer Science, online erschienen am 15.11.2024. Verfasst von Xiaorong Shen und 4 weiteren Autor:innen. Die Arbeit wurde bisher 43-mal zitiert (Crossref) und nennt 50 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Introduction
The proliferation of social media platforms has facilitated the spread of fake news, posing significant risks to public perception and societal stability. Existing methods for multimodal fake news detection have made important progress in combining textual and visual information but still face challenges in effectively aligning and merging these different types of data. These challenges often result in incomplete or inaccurate feature representations, thereby limiting overall performance.
Methods
To address these limitations, we propose a novel framework named MCOT ( M ultimodal Fake News Detection with C ontrastive Learning and O ptimal T ransport). MCOT integrates textual and visual information through three key components: cross-modal attention mechanism, contrastive learning, and optimal transport. Specifically, we first use cross-modal attention mechanism to enhance the interaction between text and image features. Then, we employ contrastive learning to align related embeddings while distinguishing unrelated pairs, and we apply optimal transport to refine the alignment of feature distributions across modalities.
Results
This integrated approach results in more precise and robust feature representations, thus enhancing detection accuracy. Experimental results on two public datasets demonstrate that the proposed MCOT outperforms state-of-the-art methods.
Discussion
Our future work will focus on improving its generalization and expanding its capabilities to additional modalities.
Zitieren
APA
Shen, X., Huang, M., Hu, Z., Cai, S., & Zhou, T. (2024). Multimodal Fake News Detection with Contrastive Learning and Optimal Transport. Frontiers in Computer Science, 6. https://doi.org/10.3389/fcomp.2024.1473457
Vancouver
Shen X, Huang M, Hu Z, Cai S, Zhou T. Multimodal Fake News Detection with Contrastive Learning and Optimal Transport. Frontiers in Computer Science. 2024;6. doi:10.3389/fcomp.2024.1473457
BibTeX
@article{Shen2024,
author = {Shen, Xiaorong and Huang, Maowei and Hu, Zheng and Cai, Shimin and Zhou, Tao},
title = {Multimodal Fake News Detection with Contrastive Learning and Optimal Transport},
journal = {Frontiers in Computer Science},
year = {2024},
volume = {6},
doi = {10.3389/fcomp.2024.1473457}
}
EUVIMED