Multimodal Social Media Fake News Detection Based on 1D-CCNet Attention Mechanism
Electronics · 18.09.2024 · 13 (18) · 3700
DOI: 10.3390/electronics13183700 ↗Kurz gefasst
Fachartikel in der Zeitschrift Electronics, online erschienen am 18.09.2024. Verfasst von Yuhan Yan und 2 weiteren Autor:innen. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 47 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Hainan Provincial Natural Science Foundation Project, National Natural Science Foundation of China.
Abstract (Originalsprache)
Due to the explosive rise of multimodal content in online social communities, cross-modal learning is crucial for accurate fake news detection. However, current multimodal fake news detection techniques face challenges in extracting features from multiple modalities and fusing cross-modal information, failing to fully exploit the correlations and complementarities between different modalities. To address these issues, this paper proposes a fake news detection model based on a one-dimensional CCNet (1D-CCNet) attention mechanism, named BTCM. This method first utilizes BERT and BLIP-2 encoders to extract text and image features. Then, it employs the proposed 1D-CCNet attention mechanism module to process the input text and image sequences, enhancing the important aspects of the bimodal features. Meanwhile, this paper uses the pre-trained BLIP-2 model for object detection in images, generating image descriptions and augmenting text data to enhance the dataset. This operation aims to further strengthen the correlations between different modalities. Finally, this paper proposes a heterogeneous cross-feature fusion method (HCFFM) to integrate image and text features. Comparative experiments were conducted on three public datasets: Twitter, Weibo, and Gossipcop. The results show that the proposed model achieved excellent performance.
Förderung
- Hainan Provincial Natural Science Foundation Project
- National Natural Science Foundation of China
Zitieren
APA
Yan, Y., Fu, H., & Wu, F. (2024). Multimodal Social Media Fake News Detection Based on 1D-CCNet Attention Mechanism. Electronics, 13(18), 3700. https://doi.org/10.3390/electronics13183700
Vancouver
Yan Y, Fu H, Wu F. Multimodal Social Media Fake News Detection Based on 1D-CCNet Attention Mechanism. Electronics. 2024;13(18):3700. doi:10.3390/electronics13183700
BibTeX
@article{Yan2024,
author = {Yan, Yuhan and Fu, Haiyan and Wu, Fan},
title = {Multimodal Social Media Fake News Detection Based on 1D-CCNet Attention Mechanism},
journal = {Electronics},
year = {2024},
volume = {13},
number = {18},
pages = {3700},
doi = {10.3390/electronics13183700}
}
EUVIMED