EUVIMEDFaigh amach EUVIMED
Open access · CC BY 4.0

A Multimodal Fake News Detection Method Based on Contrastive Learning and Variational Autoencoder

Baowen Wu, Ruijiao Hu, Jilin Wang, Xin Sui, Jiaxing Sun, Jie Liu, Youli Qu

Mathematics · 2026-05-21 · 14 (10) · 1773

DOI: 10.3390/math14101773 ↗

At a glance

Journal article in Mathematics, published online on 2026-05-21. Written by Baowen Wu and 6 co-authors. 31 references. The full text is freely available (open access, CC BY 4.0). Funded by: Yunnan Provincial Science and Technology Program Project, National Natural Science Foundation of China, Natural Science Foundation of Beijing Municipal.

AchoimreSonraí leabharliostaCiteRelated studies

Abstract (original language)

Fake news often exhibits pronounced bias and misleading content. To foster a harmonious information environment, there is an urgent need for rapid fake news identification. Fake news detection can assess news authenticity by analyzing multidimensional information such as text, images, and comments. This automated approach significantly reduces human and material resource costs. However, existing detection methods often focus on extracting textual features, employing coarse-grained fusion techniques when integrating multi-modal information, and neglecting the inherent correlations between different modalities. Meanwhile, these methods rely on static network structures and fixed feature weighting strategies, lacking targeted neural network optimization and adaptive learning mechanisms, which results in insufficient interpretability and limited generalization performance across most detection approaches. To address these challenges, from the perspective of neural network optimization and regularization enhancement, this paper proposes a multi-modal fake news detection method based on contrastive learning and variational autoencoders. Firstly, we design a dual-contrastive learning loss function as a specialized regularization strategy for multimodal neural networks. By learning features through comparing similar and dissimilar samples, it more effectively captures correlations across multimodal data, optimizing the feature distribution and enhancing the model’s generalization capability via contrastive regularization. Second, it introduces a variational autoencoder to realize adaptive learning and dynamic weight optimization assigned to unimodal and multimodal features during decision-making. This adaptive mechanism enables the model to distinguish the relative importance of different modal information, optimizing the decision-making process of the multimodal neural network and thereby improving detection accuracy. Experiments conducted on the public Chinese dataset Weibo and English dataset Twitter demonstrate that the proposed optimized network architecture outperforms other multimodal methods by 3% to 8% in terms of detection accuracy, validating the superiority of this neural network optimization-based approach for multimodal fake news detection tasks.

Funding

  • Yunnan Provincial Science and Technology Program Project
  • National Natural Science Foundation of China
  • Natural Science Foundation of Beijing Municipal
  • Yunnan Provincial Department of Education
  • Yuxiu Innovation Project of NCUT

Cite

APA

Wu, B., Hu, R., Wang, J., Sui, X., Sun, J., Liu, J., & Qu, Y. (2026). A Multimodal Fake News Detection Method Based on Contrastive Learning and Variational Autoencoder. Mathematics, 14(10), 1773. https://doi.org/10.3390/math14101773

Vancouver

Wu B, Hu R, Wang J, Sui X, Sun J, Liu J, et al. A Multimodal Fake News Detection Method Based on Contrastive Learning and Variational Autoencoder. Mathematics. 2026;14(10):1773. doi:10.3390/math14101773

BibTeX
@article{Wu2026,
  author = {Wu, Baowen and Hu, Ruijiao and Wang, Jilin and Sui, Xin and Sun, Jiaxing and Liu, Jie and Qu, Youli},
  title = {A Multimodal Fake News Detection Method Based on Contrastive Learning and Variational Autoencoder},
  journal = {Mathematics},
  year = {2026},
  volume = {14},
  number = {10},
  pages = {1773},
  doi = {10.3390/math14101773}
}
Start for free →