Roman Urdu Hate Speech Detection Using Transformer-Based Model for Cyber Security Applications
Sensors · 12.04.2023 · 23 (8) · 3909
DOI: 10.3390/s23083909 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 12.04.2023. Verfasst von Muhammad Bilal und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Computer Science, Islamia College Peshawar, Peshawar 25130, Pakistan. Hauptthemen laut MEDLINE: Hate, Speech. Die Arbeit wurde bisher 41-mal zitiert (Crossref) und nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Malaysian Institute of Information Technology, Universiti Kuala Lumpur, Kuala Lumpur, Malaysia.
Abstract (Originalsprache)
Social media applications, such as Twitter and Facebook, allow users to communicate and share their thoughts, status updates, opinions, photographs, and videos around the globe. Unfortunately, some people utilize these platforms to disseminate hate speech and abusive language. The growth of hate speech may result in hate crimes, cyber violence, and substantial harm to cyberspace, physical security, and social safety. As a result, hate speech detection is a critical issue for both cyberspace and physical society, necessitating the development of a robust application capable of detecting and combating it in real-time. Hate speech detection is a context-dependent problem that requires context-aware mechanisms for resolution. In this study, we employed a transformer-based model for Roman Urdu hate speech classification due to its ability to capture the text context. In addition, we developed the first Roman Urdu pre-trained BERT model, which we named BERT-RU. For this purpose, we exploited the capabilities of BERT by training it from scratch on the largest Roman Urdu dataset consisting of 173,714 text messages. Traditional and deep learning models were used as baseline models, including LSTM, BiLSTM, BiLSTM + Attention Layer, and CNN. We also investigated the concept of transfer learning by using pre-trained BERT embeddings in conjunction with deep learning models. The performance of each model was evaluated in terms of accuracy, precision, recall, and F-measure. The generalization of each model was evaluated on a cross-domain dataset. The experimental results revealed that the transformer-based model, when directly applied to the classification task of the Roman Urdu hate speech, outperformed traditional machine learning, deep learning models, and pre-trained transformer-based models in terms of accuracy, precision, recall, and F-measure, with scores of 96.70%, 97.25%, 96.74%, and 97.89%, respectively. In addition, the transformer-based model exhibited superior generalization on a cross-domain dataset.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Computer Science, Islamia College Peshawar, Peshawar 25130, Pakistan.
- Malaysian Institute of Information Technology, Universiti Kuala Lumpur, Kuala Lumpur 50250, Malaysia.
- Department of Computer Science, Bacha Khan University Charsadda, Charsadda 24420, Pakistan.
ORCID-Profile: Salman Jan, Shahrulniza Musa
Förderung
- Malaysian Institute of Information Technology, Universiti Kuala Lumpur, Kuala Lumpur, Malaysia
Zitieren
APA
Bilal, M., Khan, A., Jan, S., Musa, S., & Ali, S. (2023). Roman Urdu Hate Speech Detection Using Transformer-Based Model for Cyber Security Applications. Sensors, 23(8), 3909. https://doi.org/10.3390/s23083909
Vancouver
Bilal M, Khan A, Jan S, Musa S, Ali S. Roman Urdu Hate Speech Detection Using Transformer-Based Model for Cyber Security Applications. Sensors. 2023;23(8):3909. doi:10.3390/s23083909
BibTeX
@article{Bilal2023,
author = {Bilal, Muhammad and Khan, Atif and Jan, Salman and Musa, Shahrulniza and Ali, Shaukat},
title = {Roman Urdu Hate Speech Detection Using Transformer-Based Model for Cyber Security Applications},
journal = {Sensors},
year = {2023},
volume = {23},
number = {8},
pages = {3909},
doi = {10.3390/s23083909}
}
EUVIMED