A Novel Hybrid Attention-Based RoBERTa-BiLSTM Model for Cyberbullying Detection
Mathematical and Computational Applications · 21.08.2025 · 30 (4) · 91
DOI: 10.3390/mca30040091 ↗Kurz gefasst
Fachartikel in der Zeitschrift Mathematical and Computational Applications, online erschienen am 21.08.2025. Verfasst von Mohammed A. Mahdi und 6 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 47 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Deanship of Scientific Research at the University of Ha’il, Saudi Arabia.
Abstract (Originalsprache)
The escalating scale and psychological harm of cyberbullying across digital platforms present a critical social challenge, demanding the urgent development of highly accurate and reliable automated detection systems. Standard fine-tuned transformer models, while powerful, often fall short in capturing the nuanced, context-dependent nature of online harassment. This paper introduces a novel hybrid deep learning model called Robustly Optimized Bidirectional Encoder Representations from the Transformers with the Bidirectional Long Short-Term Memory-based Attention model (RoBERTa-BiLSTM), specifically designed to address this challenge. To maximize its effectiveness, the model was systematically optimized using the Optuna framework and rigorously benchmarked against eight state-of-the-art transformer baseline models on a large cyberbullying dataset. Our proposed model achieves state-of-the-art performance, outperforming BERT-base, RoBERTa-base, RoBERTa-large, DistilBERT, ALBERT-xxlarge, XLNet-large, ELECTRA-base, DeBERTa-v3-small with an accuracy of 94.8%, precision of 96.4%, recall of 95.3%, F1-score of 95.8%, and an AUC of 98.5%. Significantly, it demonstrates a substantial improvement in F1-score over the strongest baseline and reduces critical false negative errors by 43%, all while maintaining moderate computational efficiency. Furthermore, our efficiency analysis indicates that this superior performance is achieved with a moderate computational complexity. The results validate our hypothesis that a specialized hybrid architecture, which synergizes contextual embedding with sequential processing and attention mechanism, offers a more robust and practical solution for real-world social media applications.
Förderung
- Deanship of Scientific Research at the University of Ha’il, Saudi Arabia
Zitieren
APA
Mahdi, M. A., Fati, S. M., Ragab, M. G., Hazber, M. A. G., Ahamad, S., Saad, S. A., & Al-Shalabi, M. (2025). A Novel Hybrid Attention-Based RoBERTa-BiLSTM Model for Cyberbullying Detection. Mathematical and Computational Applications, 30(4), 91. https://doi.org/10.3390/mca30040091
Vancouver
Mahdi MA, Fati SM, Ragab MG, Hazber MAG, Ahamad S, Saad SA, et al. A Novel Hybrid Attention-Based RoBERTa-BiLSTM Model for Cyberbullying Detection. Mathematical and Computational Applications. 2025;30(4):91. doi:10.3390/mca30040091
BibTeX
@article{Mahdi2025,
author = {Mahdi, Mohammed A. and Fati, Suliman Mohamed and Ragab, Mohammed Gamal and Hazber, Mohamed A. G. and Ahamad, Shahanawaj and Saad, Sawsan A. and Al-Shalabi, Mohammed},
title = {A Novel Hybrid Attention-Based RoBERTa-BiLSTM Model for Cyberbullying Detection},
journal = {Mathematical and Computational Applications},
year = {2025},
volume = {30},
number = {4},
pages = {91},
doi = {10.3390/mca30040091}
}
EUVIMED