Performance Comparison of IndoBERT and IndoRoBERTa with SMOTE for Indonesian Hate Speech Detection
Qomaruna · 30.06.2026 · 3 (2) · 149-163
DOI: 10.62048/qjms.v3i2.167 ↗Kurz gefasst
Fachartikel in der Zeitschrift Qomaruna, online erschienen am 30.06.2026. Verfasst von Muhammad Mutawakkil Alallah und 1 weiteren Autor:innen.
Abstract (Originalsprache)
The rapid growth of social media in Indonesia has increased digital interaction while also giving rise to hate speech issues that affect communication quality and social stability. This study aims to compare the performance of two Transformer-based models, IndoBERT and IndoRoBERTa, in Indonesian-language hate speech classification and to evaluate the effect of the SMOTE data balancing technique. The dataset consisted of Indonesian-language Twitter data that underwent preprocessing and was divided using an 80:20 stratified train-test split. Model training was conducted through fine-tuning, while evaluation employed accuracy, precision, recall, and F1-score metrics. The results show that IndoRoBERTa outperformed IndoBERT across all evaluation metrics and was more effective in reducing classification errors. The application of SMOTE also improved the models' ability to detect minority classes, particularly in terms of recall. These findings indicate that the combination of Transformer-based models and data balancing techniques is effective in improving both classification accuracy and class balance in hate speech detection. Furthermore, the results suggest that the combination of IndoRoBERTa and SMOTE has strong potential to support the development of more accurate and adaptive automated content moderation systems for Indonesian-language social media platforms.
Zitieren
APA
Alallah, M. M., & Rosyidah, I. (2026). Performance Comparison of IndoBERT and IndoRoBERTa with SMOTE for Indonesian Hate Speech Detection. Qomaruna, 3(2), 149-163. https://doi.org/10.62048/qjms.v3i2.167
Vancouver
Alallah MM, Rosyidah I. Performance Comparison of IndoBERT and IndoRoBERTa with SMOTE for Indonesian Hate Speech Detection. Qomaruna. 2026;3(2):149-163. doi:10.62048/qjms.v3i2.167
BibTeX
@article{Alallah2026,
author = {Alallah, Muhammad Mutawakkil and Rosyidah, Indra},
title = {Performance Comparison of IndoBERT and IndoRoBERTa with SMOTE for Indonesian Hate Speech Detection},
journal = {Qomaruna},
year = {2026},
volume = {3},
number = {2},
pages = {149--163},
doi = {10.62048/qjms.v3i2.167}
}
EUVIMED