EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Novel Hybrid Attention-Based RoBERTa-BiLSTM Model for Cyberbullying Detection

Mohammed A. Mahdi, Suliman Mohamed Fati, Mohammed Gamal Ragab, Mohamed A. G. Hazber, Shahanawaj Ahamad, Sawsan A. Saad, Mohammed Al-Shalabi

Mathematical and Computational Applications · 21.08.2025 · 30 (4) · 91

DOI: 10.3390/mca30040091 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Mathematical and Computational Applications, online erschienen am 21.08.2025. Verfasst von Mohammed A. Mahdi und 6 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 47 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Deanship of Scientific Research at the University of Ha’il, Saudi Arabia.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The escalating scale and psychological harm of cyberbullying across digital platforms present a critical social challenge, demanding the urgent development of highly accurate and reliable automated detection systems. Standard fine-tuned transformer models, while powerful, often fall short in capturing the nuanced, context-dependent nature of online harassment. This paper introduces a novel hybrid deep learning model called Robustly Optimized Bidirectional Encoder Representations from the Transformers with the Bidirectional Long Short-Term Memory-based Attention model (RoBERTa-BiLSTM), specifically designed to address this challenge. To maximize its effectiveness, the model was systematically optimized using the Optuna framework and rigorously benchmarked against eight state-of-the-art transformer baseline models on a large cyberbullying dataset. Our proposed model achieves state-of-the-art performance, outperforming BERT-base, RoBERTa-base, RoBERTa-large, DistilBERT, ALBERT-xxlarge, XLNet-large, ELECTRA-base, DeBERTa-v3-small with an accuracy of 94.8%, precision of 96.4%, recall of 95.3%, F1-score of 95.8%, and an AUC of 98.5%. Significantly, it demonstrates a substantial improvement in F1-score over the strongest baseline and reduces critical false negative errors by 43%, all while maintaining moderate computational efficiency. Furthermore, our efficiency analysis indicates that this superior performance is achieved with a moderate computational complexity. The results validate our hypothesis that a specialized hybrid architecture, which synergizes contextual embedding with sequential processing and attention mechanism, offers a more robust and practical solution for real-world social media applications.

Förderung

  • Deanship of Scientific Research at the University of Ha’il, Saudi Arabia

Zitieren

APA

Mahdi, M. A., Fati, S. M., Ragab, M. G., Hazber, M. A. G., Ahamad, S., Saad, S. A., & Al-Shalabi, M. (2025). A Novel Hybrid Attention-Based RoBERTa-BiLSTM Model for Cyberbullying Detection. Mathematical and Computational Applications, 30(4), 91. https://doi.org/10.3390/mca30040091

Vancouver

Mahdi MA, Fati SM, Ragab MG, Hazber MAG, Ahamad S, Saad SA, et al. A Novel Hybrid Attention-Based RoBERTa-BiLSTM Model for Cyberbullying Detection. Mathematical and Computational Applications. 2025;30(4):91. doi:10.3390/mca30040091

BibTeX
@article{Mahdi2025,
  author = {Mahdi, Mohammed A. and Fati, Suliman Mohamed and Ragab, Mohammed Gamal and Hazber, Mohamed A. G. and Ahamad, Shahanawaj and Saad, Sawsan A. and Al-Shalabi, Mohammed},
  title = {A Novel Hybrid Attention-Based RoBERTa-BiLSTM Model for Cyberbullying Detection},
  journal = {Mathematical and Computational Applications},
  year = {2025},
  volume = {30},
  number = {4},
  pages = {91},
  doi = {10.3390/mca30040091}
}
Kostenlos starten →