Towards Reliable Fake News Detection: Enhanced Attention-Based Transformer Model
Journal of Cybersecurity and Privacy · 09.07.2025 · 5 (3) · 43
DOI: 10.3390/jcp5030043 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Cybersecurity and Privacy, online erschienen am 09.07.2025. Verfasst von Jayanti Rout und 2 weiteren Autor:innen. Die Arbeit wurde bisher 25-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Biomedical Sensors and Systems Lab, University of Memphis, Memphis, TN 38152, USA.
Abstract (Originalsprache)
The widespread rise of misinformation across digital platforms has increased the demand for accurate and efficient Fake News Detection (FND) systems. This study introduces an enhanced transformer-based architecture for FND, developed through comprehensive ablation studies and empirical evaluations on multiple benchmark datasets. The proposed model combines improved multi-head attention, dynamic positional encoding, and a lightweight classification head to effectively capture nuanced linguistic patterns, while maintaining computational efficiency. To ensure robust training, techniques such as label smoothing, learning rate warm-up, and reproducibility protocols were incorporated. The model demonstrates strong generalization across three diverse datasets, such as FakeNewsNet, ISOT, and LIAR, achieving an average accuracy of 79.85%. Specifically, it attains 80% accuracy on FakeNewsNet, 100% on ISOT, and 59.56% on LIAR. With just 3.1 to 4.3 million parameters, the model achieves an 85% reduction in size compared to full-sized BERT architectures. These results highlight the model’s effectiveness in balancing high accuracy with resource efficiency, making it suitable for real-world applications such as social media monitoring and automated fact-checking. Future work will explore multilingual extensions, cross-domain generalization, and integration with multimodal misinformation detection systems.
Förderung
- Biomedical Sensors and Systems Lab, University of Memphis, Memphis, TN 38152, USA
Zitieren
APA
Rout, J., Mishra, M., & Saikia, M. J. (2025). Towards Reliable Fake News Detection: Enhanced Attention-Based Transformer Model. Journal of Cybersecurity and Privacy, 5(3), 43. https://doi.org/10.3390/jcp5030043
Vancouver
Rout J, Mishra M, Saikia MJ. Towards Reliable Fake News Detection: Enhanced Attention-Based Transformer Model. Journal of Cybersecurity and Privacy. 2025;5(3):43. doi:10.3390/jcp5030043
BibTeX
@article{Rout2025,
author = {Rout, Jayanti and Mishra, Minati and Saikia, Manob Jyoti},
title = {Towards Reliable Fake News Detection: Enhanced Attention-Based Transformer Model},
journal = {Journal of Cybersecurity and Privacy},
year = {2025},
volume = {5},
number = {3},
pages = {43},
doi = {10.3390/jcp5030043}
}
EUVIMED