EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Towards Reliable Fake News Detection: Enhanced Attention-Based Transformer Model

Jayanti Rout, Minati Mishra, Manob Jyoti Saikia

Journal of Cybersecurity and Privacy · 09.07.2025 · 5 (3) · 43

DOI: 10.3390/jcp5030043 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Cybersecurity and Privacy, online erschienen am 09.07.2025. Verfasst von Jayanti Rout und 2 weiteren Autor:innen. Die Arbeit wurde bisher 25-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Biomedical Sensors and Systems Lab, University of Memphis, Memphis, TN 38152, USA.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The widespread rise of misinformation across digital platforms has increased the demand for accurate and efficient Fake News Detection (FND) systems. This study introduces an enhanced transformer-based architecture for FND, developed through comprehensive ablation studies and empirical evaluations on multiple benchmark datasets. The proposed model combines improved multi-head attention, dynamic positional encoding, and a lightweight classification head to effectively capture nuanced linguistic patterns, while maintaining computational efficiency. To ensure robust training, techniques such as label smoothing, learning rate warm-up, and reproducibility protocols were incorporated. The model demonstrates strong generalization across three diverse datasets, such as FakeNewsNet, ISOT, and LIAR, achieving an average accuracy of 79.85%. Specifically, it attains 80% accuracy on FakeNewsNet, 100% on ISOT, and 59.56% on LIAR. With just 3.1 to 4.3 million parameters, the model achieves an 85% reduction in size compared to full-sized BERT architectures. These results highlight the model’s effectiveness in balancing high accuracy with resource efficiency, making it suitable for real-world applications such as social media monitoring and automated fact-checking. Future work will explore multilingual extensions, cross-domain generalization, and integration with multimodal misinformation detection systems.

Förderung

  • Biomedical Sensors and Systems Lab, University of Memphis, Memphis, TN 38152, USA

Zitieren

APA

Rout, J., Mishra, M., & Saikia, M. J. (2025). Towards Reliable Fake News Detection: Enhanced Attention-Based Transformer Model. Journal of Cybersecurity and Privacy, 5(3), 43. https://doi.org/10.3390/jcp5030043

Vancouver

Rout J, Mishra M, Saikia MJ. Towards Reliable Fake News Detection: Enhanced Attention-Based Transformer Model. Journal of Cybersecurity and Privacy. 2025;5(3):43. doi:10.3390/jcp5030043

BibTeX
@article{Rout2025,
  author = {Rout, Jayanti and Mishra, Minati and Saikia, Manob Jyoti},
  title = {Towards Reliable Fake News Detection: Enhanced Attention-Based Transformer Model},
  journal = {Journal of Cybersecurity and Privacy},
  year = {2025},
  volume = {5},
  number = {3},
  pages = {43},
  doi = {10.3390/jcp5030043}
}
Kostenlos starten →