EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Multimodal Fake News Detection with Contrastive Learning and Optimal Transport

Xiaorong Shen, Maowei Huang, Zheng Hu, Shimin Cai, Tao Zhou

Frontiers in Computer Science · 15.11.2024 · 6

DOI: 10.3389/fcomp.2024.1473457 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Frontiers in Computer Science, online erschienen am 15.11.2024. Verfasst von Xiaorong Shen und 4 weiteren Autor:innen. Die Arbeit wurde bisher 43-mal zitiert (Crossref) und nennt 50 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Introduction

The proliferation of social media platforms has facilitated the spread of fake news, posing significant risks to public perception and societal stability. Existing methods for multimodal fake news detection have made important progress in combining textual and visual information but still face challenges in effectively aligning and merging these different types of data. These challenges often result in incomplete or inaccurate feature representations, thereby limiting overall performance.

Methods

To address these limitations, we propose a novel framework named MCOT ( M ultimodal Fake News Detection with C ontrastive Learning and O ptimal T ransport). MCOT integrates textual and visual information through three key components: cross-modal attention mechanism, contrastive learning, and optimal transport. Specifically, we first use cross-modal attention mechanism to enhance the interaction between text and image features. Then, we employ contrastive learning to align related embeddings while distinguishing unrelated pairs, and we apply optimal transport to refine the alignment of feature distributions across modalities.

Results

This integrated approach results in more precise and robust feature representations, thus enhancing detection accuracy. Experimental results on two public datasets demonstrate that the proposed MCOT outperforms state-of-the-art methods.

Discussion

Our future work will focus on improving its generalization and expanding its capabilities to additional modalities.

Zitieren

APA

Shen, X., Huang, M., Hu, Z., Cai, S., & Zhou, T. (2024). Multimodal Fake News Detection with Contrastive Learning and Optimal Transport. Frontiers in Computer Science, 6. https://doi.org/10.3389/fcomp.2024.1473457

Vancouver

Shen X, Huang M, Hu Z, Cai S, Zhou T. Multimodal Fake News Detection with Contrastive Learning and Optimal Transport. Frontiers in Computer Science. 2024;6. doi:10.3389/fcomp.2024.1473457

BibTeX
@article{Shen2024,
  author = {Shen, Xiaorong and Huang, Maowei and Hu, Zheng and Cai, Shimin and Zhou, Tao},
  title = {Multimodal Fake News Detection with Contrastive Learning and Optimal Transport},
  journal = {Frontiers in Computer Science},
  year = {2024},
  volume = {6},
  doi = {10.3389/fcomp.2024.1473457}
}
Kostenlos starten →