A bilingual Malay-English social media dataset for binary hate speech detection
Data in Brief · 2025-12 · 63 · 112153
DOI: 10.1016/j.dib.2025.112153 ↗Kurz gefasst
Fachartikel in der Zeitschrift Data in Brief, 2025-12. Verfasst von Jun-Chen Tan und 2 weiteren Autor:innen. Beteiligte Einrichtung: Faculty of Information Science and Technology, Multimedia University, Melaka, 75450 Malaysia. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 13 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: Telekom Malaysia Berhad.
Abstract (Originalsprache)
In recent years, online hate speech has posed a growing threat to user safety, social harmony, and community cohesion especially on social media platforms. However, most existing hate speech datasets are monolingual and resource-rich, which leave Southeast Asia languages such as Malay underrepresented in natural language processing research. The aim of this dataset is to handle this gap by providing a balanced and quality-controlled resource that supports machine learning applications in multilingual settings. Binary classification is selected as a foundation task because it simplifies practical deployment in real-world and early-stage detection systems. It is beneficial in low-resource languages where detailed or multi-label annotations are always unavailable or inconsistent. This dataset presents 26,985 bilingual Malay-English social media texts curated from five public sources for binary hate speech detection. It combines human-annotated and filtered through controlled pseudo-labelling to retain only high-confidence, quality-controlled texts. The dataset is provided in UTF-8 encoded CSV format with 13,609 English and 13,376 Malay-language texts. Each entry includes the social media post, binary label (0 = non-hate, 1 = hate), language identifier (en or ms), and data source information. The dataset meets clear practical demands, including training multilingual transformer-based classifiers, benchmarking cross-lingual NLP models, and developing effective hate speech detection systems and educational NLP resources for English and Malay-speaking communities.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Faculty of Information Science and Technology, Multimedia University, Melaka, 75450 Malaysia.
Förderung
- Telekom Malaysia Berhad
Zitieren
APA
Tan, J. C., Ong, L. Y., & Leow, M. C. (2025). A bilingual Malay-English social media dataset for binary hate speech detection. Data in Brief, 63, 112153. https://doi.org/10.1016/j.dib.2025.112153
Vancouver
Tan JC, Ong LY, Leow MC. A bilingual Malay-English social media dataset for binary hate speech detection. Data in Brief. 2025;63:112153. doi:10.1016/j.dib.2025.112153
BibTeX
@article{Tan2025,
author = {Tan, Jun-Chen and Ong, Lee-Yeng and Leow, Meng-Chew},
title = {A bilingual Malay-English social media dataset for binary hate speech detection},
journal = {Data in Brief},
year = {2025},
volume = {63},
pages = {112153},
doi = {10.1016/j.dib.2025.112153}
}
EUVIMED