Indonesian Hate Speech Detection under Class Imbalance Using a Soft-Voting Ensemble of IndoBERTweet and IndoRoBERTa
Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi) · 24.06.2026 · 10 (3) · 814-824
DOI: 10.29207/resti.v10i3.7681 ↗Kurz gefasst
Fachartikel in der Zeitschrift Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi), online erschienen am 24.06.2026. Verfasst von Muhammad Alkaff und 4 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Hate speech detection on Indonesian social media remains challenging due to the coexistence of formal and highly colloquial language, as well as the moderate class imbalance typical of real-world datasets. Models trained under these conditions often skew toward the majority class and generalize poorly across linguistic registers. This study investigates whether a simple, training-free model-level ensemble can improve Indonesian hate speech detection under such conditions without resampling the data. IndoBERTweet and IndoRoBERTa, pretrained respectively on informal Twitter text and broader formal corpora, serve as complementary base models, and their class probabilities are combined through equal-weight soft voting. On the Indonesian Hate Speech Superset (N = 14,306), evaluated across five random seeds with paired significance testing, the soft-voting ensemble attains a macro-averaged F1 of 0.898 ± 0.003 and a macro recall of 0.899 ± 0.003. It significantly outperforms a TF-IDF SVM baseline and the IndoRoBERTa base model, while showing no significant difference from the stronger IndoBERTweet base model and a trained logistic-regression stacking ensemble. Notably, the ensemble matches the stacking ensemble without any additional training stage or meta-learner, and a calibration analysis shows it improves probability calibration over both base models. These results indicate that equal-weight probability averaging is a simple, reproducible, and competitive strategy for Indonesian hate speech detection under moderate class imbalance.
Zitieren
APA
Alkaff, M., Wijaya, E. S., Fadliyanur, F., Bahit, M., & Ilyasa, S. N. (2026). Indonesian Hate Speech Detection under Class Imbalance Using a Soft-Voting Ensemble of IndoBERTweet and IndoRoBERTa. Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi), 10(3), 814-824. https://doi.org/10.29207/resti.v10i3.7681
Vancouver
Alkaff M, Wijaya ES, Fadliyanur F, Bahit M, Ilyasa SN. Indonesian Hate Speech Detection under Class Imbalance Using a Soft-Voting Ensemble of IndoBERTweet and IndoRoBERTa. Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi). 2026;10(3):814-824. doi:10.29207/resti.v10i3.7681
BibTeX
@article{Alkaff2026,
author = {Alkaff, Muhammad and Wijaya, Eka Setya and Fadliyanur, Fadliyanur and Bahit, Muhammad and Ilyasa, Sinar Nadhif},
title = {Indonesian Hate Speech Detection under Class Imbalance Using a Soft-Voting Ensemble of IndoBERTweet and IndoRoBERTa},
journal = {Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi)},
year = {2026},
volume = {10},
number = {3},
pages = {814--824},
doi = {10.29207/resti.v10i3.7681}
}
EUVIMED