Perbandingan IndoBERT dan mBERT Untuk Klasifikasi Toksisitas Pada Chat Roblox dan Minecraft Berbahasa Indonesia
Jurnal Manajemen dan Teknologi · 25.11.2026 · 3 (2) · 557-569
DOI: 10.63447/jmt.v3i2.2196 ↗Kurz gefasst
Fachartikel in der Zeitschrift Jurnal Manajemen dan Teknologi, online erschienen am 25.11.2026. Verfasst von Idris Sonny und 4 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Toxic chat in online games exposes young players to harassment, while moderation of Indonesian chat is hampered by slang and non-standard spelling. This study compares monolingual IndoBERT and multilingual mBERT for four-class toxicity classification (neutral, violence, racist, harassment) of Indonesian Roblox and Minecraft chat to identify the more suitable model for moderation. Both models were fine-tuned with identical settings on the Indonesian Chat Dataset (10,702 chats) using three seeds, and evaluated with accuracy, macro-averaged precision, recall, F1-score, and McNemar’s test. IndoBERT reached a mean macro F1-score of 0.8541 ± 0.0019 versus 0.8263 ± 0.0090 for mBERT, significant in two of three seeds. Neutral was the hardest class, and IndoBERT let 5.8% of toxic chats pass as neutral versus 8.3% for mBERT. Excluding 106 duplicated test chats did not change the ranking. Under these settings, IndoBERT performed better, although labels lack inter-annotator agreement and data cover two games only.
Zitieren
APA
Sonny, I., Meiriza, A., Novianti, H., Afriani, M., & Kurnia, R. D. (2026). Perbandingan IndoBERT dan mBERT Untuk Klasifikasi Toksisitas Pada Chat Roblox dan Minecraft Berbahasa Indonesia. Jurnal Manajemen dan Teknologi, 3(2), 557-569. https://doi.org/10.63447/jmt.v3i2.2196
Vancouver
Sonny I, Meiriza A, Novianti H, Afriani M, Kurnia RD. Perbandingan IndoBERT dan mBERT Untuk Klasifikasi Toksisitas Pada Chat Roblox dan Minecraft Berbahasa Indonesia. Jurnal Manajemen dan Teknologi. 2026;3(2):557-569. doi:10.63447/jmt.v3i2.2196
BibTeX
@article{Sonny2026,
author = {Sonny, Idris and Meiriza, Allsela and Novianti, Hardini and Afriani, Mira and Kurnia, Rizka Dhina},
title = {Perbandingan IndoBERT dan mBERT Untuk Klasifikasi Toksisitas Pada Chat Roblox dan Minecraft Berbahasa Indonesia},
journal = {Jurnal Manajemen dan Teknologi},
year = {2026},
volume = {3},
number = {2},
pages = {557--569},
doi = {10.63447/jmt.v3i2.2196}
}
EUVIMED