EUVIMEDObjevte EUVIMED
Open access · CC BY 4.0

A Multimodal Ensemble-Based Framework for Detecting Fake News Using Visual and Textual Features

Muhammad Abdullah, Hongying Zan, Arifa Javed, Muhammad Sohail, Orken Mamyrbayev, Zhanibek Turysbek, Hassan Eshkiki, Fabio Caraffini

Mathematics · 2026-01-21 · 14 (2) · 360

DOI: 10.3390/math14020360 ↗

At a glance

Journal article in Mathematics, published online on 2026-01-21. Written by Muhammad Abdullah and 7 co-authors. Cited 10 times so far (Crossref); 79 references. The full text is freely available (open access, CC BY 4.0).

AbstraktBibliografické údajeCiteRelated studies

Abstract (original language)

Detecting fake news is essential in natural language processing to verify news authenticity and prevent misinformation-driven social, political, and economic disruptions targeting specific groups. A major challenge in multimodal fake news detection is effectively integrating textual and visual modalities, as semantic gaps and contextual variations between images and text complicate alignment, interpretation, and the detection of subtle or blatant inconsistencies. To enhance accuracy in fake news detection, this article introduces an ensemble-based framework that integrates textual and visual data using ViLBERT’s two-stream architecture, incorporates VADER sentiment analysis to detect emotional language, and uses Image–Text Contextual Similarity to identify mismatches between visual and textual elements. These features are processed through the Bi-GRU classifier, Transformer-XL, DistilBERT, and XLNet, combined via a stacked ensemble method with soft voting, culminating in a T5 metaclassifier that predicts the outcome for robustness. Results on the Fakeddit and Weibo benchmarking datasets show that our method outperforms state-of-the-art models, achieving up to 96% and 94% accuracy in fake news detection, respectively. This study highlights the necessity for advanced multimodal fake news detection systems to address the increasing complexity of misinformation and offers a promising solution.

Cite

APA

Abdullah, M., Zan, H., Javed, A., Sohail, M., Mamyrbayev, O., Turysbek, Z., Eshkiki, H., & Caraffini, F. (2026). A Multimodal Ensemble-Based Framework for Detecting Fake News Using Visual and Textual Features. Mathematics, 14(2), 360. https://doi.org/10.3390/math14020360

Vancouver

Abdullah M, Zan H, Javed A, Sohail M, Mamyrbayev O, Turysbek Z, et al. A Multimodal Ensemble-Based Framework for Detecting Fake News Using Visual and Textual Features. Mathematics. 2026;14(2):360. doi:10.3390/math14020360

BibTeX
@article{Abdullah2026,
  author = {Abdullah, Muhammad and Zan, Hongying and Javed, Arifa and Sohail, Muhammad and Mamyrbayev, Orken and Turysbek, Zhanibek and Eshkiki, Hassan and Caraffini, Fabio},
  title = {A Multimodal Ensemble-Based Framework for Detecting Fake News Using Visual and Textual Features},
  journal = {Mathematics},
  year = {2026},
  volume = {14},
  number = {2},
  pages = {360},
  doi = {10.3390/math14020360}
}
Start for free →