EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Hybrid BERT-CNN with Multihead Self-Attention for Automated Cyberbullying Detection

Meruert Yerekesheva, Oxana Akhmetova, Assel Kaziyeva, Daniyar Sultan, Aigerim Toktarova, Rustam Abdrakhmanov, Tolep Abdimukhan

Engineering, Technology & Applied Science Research · 09.02.2026 · 16 (1) · 30716-30724

DOI: 10.48084/etasr.12741 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Engineering, Technology & Applied Science Research, online erschienen am 09.02.2026. Verfasst von Meruert Yerekesheva und 6 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This paper presents a novel hybrid deep learning architecture, the CustomBERTCNNAttentionModel, designed for the automated detection of cyberbullying in social media text. The proposed model integrates the contextual language understanding capabilities of Bidirectional Encoder Representations from Transformers (BERT) with the local feature extraction strengths of Convolutional Neural Networks (CNNs) and the dynamic relevance weighting of multihead self-attention mechanisms. Evaluated on the Kaggle Cyberbullying Dataset, which includes both binary and multiclass labels, the model demonstrates superior performance compared to traditional classifiers and ensemble methods. The architecture effectively handles imbalanced and noisy text data, achieving an accuracy of 0.9853 in binary classification tasks. A comprehensive evaluation using standard metrics and visual analysis through confusion matrices confirms the model's robustness and its capacity to generalize across diverse types of cyberbullying. These results highlight the effectiveness of combining transformer-based embeddings with attention-enhanced convolutional structures for detecting harmful online behavior and contribute to the advancement of intelligent moderation systems.

Zitieren

APA

Yerekesheva, M., Akhmetova, O., Kaziyeva, A., Sultan, D., Toktarova, A., Abdrakhmanov, R., & Abdimukhan, T. (2026). A Hybrid BERT-CNN with Multihead Self-Attention for Automated Cyberbullying Detection. Engineering, Technology & Applied Science Research, 16(1), 30716-30724. https://doi.org/10.48084/etasr.12741

Vancouver

Yerekesheva M, Akhmetova O, Kaziyeva A, Sultan D, Toktarova A, Abdrakhmanov R, et al. A Hybrid BERT-CNN with Multihead Self-Attention for Automated Cyberbullying Detection. Engineering, Technology & Applied Science Research. 2026;16(1):30716-30724. doi:10.48084/etasr.12741

BibTeX
@article{Yerekesheva2026,
  author = {Yerekesheva, Meruert and Akhmetova, Oxana and Kaziyeva, Assel and Sultan, Daniyar and Toktarova, Aigerim and Abdrakhmanov, Rustam and Abdimukhan, Tolep},
  title = {A Hybrid BERT-CNN with Multihead Self-Attention for Automated Cyberbullying Detection},
  journal = {Engineering, Technology & Applied Science Research},
  year = {2026},
  volume = {16},
  number = {1},
  pages = {30716--30724},
  doi = {10.48084/etasr.12741}
}
Kostenlos starten →