Fusing Transformer-XL with bi-directional recurrent networks for cyberbullying detection
PeerJ Computer Science · 17.06.2025 · 11 · e2940
DOI: 10.7717/peerj-cs.2940 ↗Kurz gefasst
Fachartikel in der Zeitschrift PeerJ Computer Science, online erschienen am 17.06.2025. Verfasst von Md Mithun Hossain und 6 weiteren Autor:innen. Beteiligte Einrichtung: Department of Computer Science and Engineering, Bangladesh University of Business and Technology, Dhaka, Bangladesh. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 37 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Research Chair of Online Dialogue and Cultural Communication at King Saud University, Riyadh, Saudi Arabia.
Abstract (Originalsprache)
Identifying cyberbullying in languages other than English presents distinct difficulties owing to linguistic subtleties and scarcity of annotated datasets. This article presents a new method for identifying cyberbullying in Bengali text data using the Kaggle dataset. This strategy combines Transformer-Extra Large (XL) with bi-directional recurrent neural networks (BiGRU-BiLSTM). Extensive data preparation was performed, including data cleaning, data analysis, and label encoding. Upsampling methods were used to handle imbalanced classes, and data augmentation enhanced the training dataset. We carried out tokenization of the text using a pre-trained tokenizer to capture semantic representations accurately. The model we presented, Transformer-XL-bidirectional gated recurrent units (BiGRU)-bidirectional long short-term memory (BiLSTM), which is called Fusion Transformer-XL, surpassed the performance of the baseline models, attaining an accuracy of 98.17% and an F1-score of 98.18%. Local interpretable model-agnostic explanation (LIME) text explanations were used to understand the reasoning behind the model’s choices and performed the cross-dataset evaluation of the model using the English dataset. This helped improve the clarity and reliability of the proposed method. Furthermore, implementing k-fold cross-validation ensures our model’s robustness and adaptability across diverse data categories. The results of our study demonstrate the effectiveness of combining Transformer-XL with bi-directional recurrent networks for detecting cyberbullying in Bengali. This emphasizes the significance of using hybrid architectures to address intricate natural language processing problems in languages with limited resources. This study enhances the development of methods for detecting cyberbullying and opens up opportunities for additional investigation into language diversity and social media analytics.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Computer Science and Engineering, Bangladesh University of Business and Technology, Dhaka, Bangladesh.
- Department of Computer Science, American International University-Bangladesh, Dhaka, Bangladesh.
- Research Chair of Online Dialogue and Cultural Communication, Department of Computer Science, College of Computer and Information Sciences, King Saud University, Riyadh, Saudi Arabia.
- Department of Electrical Engineering and Computer Science, Texas A&M University-Kingsville, Texas, United States.
ORCID-Profile: Md Mithun Hossain, Md Shakil Hossain, Md Shakhawat Hossain
Förderung
- Research Chair of Online Dialogue and Cultural Communication at King Saud University, Riyadh, Saudi Arabia
Zitieren
APA
Hossain, M. M., Hossain, M. S., Hossain, M. S., Mridha, M. F., Safran, M., Alfarhood, S., & Che, D. (2025). Fusing Transformer-XL with bi-directional recurrent networks for cyberbullying detection. PeerJ Computer Science, 11, e2940. https://doi.org/10.7717/peerj-cs.2940
Vancouver
Hossain MM, Hossain MS, Hossain MS, Mridha MF, Safran M, Alfarhood S, et al. Fusing Transformer-XL with bi-directional recurrent networks for cyberbullying detection. PeerJ Computer Science. 2025;11:e2940. doi:10.7717/peerj-cs.2940
BibTeX
@article{Hossain2025,
author = {Hossain, Md Mithun and Hossain, Md Shakil and Hossain, Md Shakhawat and Mridha, M Firoz and Safran, Mejdl and Alfarhood, Sultan and Che, Dunren},
title = {Fusing Transformer-XL with bi-directional recurrent networks for cyberbullying detection},
journal = {PeerJ Computer Science},
year = {2025},
volume = {11},
pages = {e2940},
doi = {10.7717/peerj-cs.2940}
}
EUVIMED