A BERT-Based Multimodal Framework for Enhanced Fake News Detection Using Text and Image Data Fusion
Computers · 2025-06-16 · 14 (6) · 237
DOI: 10.3390/computers14060237 ↗At a glance
Journal article in Computers, published online on 2025-06-16. Written by Mohammed Al-alshaqi and 2 co-authors. Cited 27 times so far (Crossref); 64 references. The full text is freely available (open access, CC BY 4.0). Funded by: NSF.
Abstract (original language)
The spread of fake news on social media is complicated by the fact that fake information spreads extremely fast in both textual and visual formats. Traditional approaches to the detection of fake news focus mainly on text and image features, thereby missing valuable information contained within images and texts. In response to this, we propose a multimodal fake news detection method based on BERT, with an extension to text combined with the extracted text from images through Optical Character Recognition (OCR). Here, we consider extending feature analysis with BERT_base_uncased to process inputs for retrieving relevant text from images and determining a confidence score that suggests the probability of the news being authentic. We report extensive experimental results on the ISOT, WELFAKE, TRUTHSEEKER, and ISOT_WELFAKE_TRUTHSEEKER datasets. Our proposed model demonstrates better generalization on the TRUTHSEEKER dataset with an accuracy of 99.97%, achieving substantial improvements over existing methods with an F1-score of 0.98. Experimental results indicate a potential accuracy increment of +3.35% compared to the latest baselines. These results highlight the potential of our approach to serve as a strong resource for automatic fake news detection by effectively integrating both text and visual data streams. Findings suggest that using diverse datasets enhances the resilience of detection systems against misinformation strategies.
Funding
- NSF
Cite
APA
Al-alshaqi, M., Rawat, D. B., & Liu, C. (2025). A BERT-Based Multimodal Framework for Enhanced Fake News Detection Using Text and Image Data Fusion. Computers, 14(6), 237. https://doi.org/10.3390/computers14060237
Vancouver
Al-alshaqi M, Rawat DB, Liu C. A BERT-Based Multimodal Framework for Enhanced Fake News Detection Using Text and Image Data Fusion. Computers. 2025;14(6):237. doi:10.3390/computers14060237
BibTeX
@article{Alalshaqi2025,
author = {Al-alshaqi, Mohammed and Rawat, Danda B. and Liu, Chunmei},
title = {A BERT-Based Multimodal Framework for Enhanced Fake News Detection Using Text and Image Data Fusion},
journal = {Computers},
year = {2025},
volume = {14},
number = {6},
pages = {237},
doi = {10.3390/computers14060237}
}
EUVIMED