EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Indonesian Hate Speech Detection under Class Imbalance Using a Soft-Voting Ensemble of IndoBERTweet and IndoRoBERTa

Muhammad Alkaff, Eka Setya Wijaya, Fadliyanur Fadliyanur, Muhammad Bahit, Sinar Nadhif Ilyasa

Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi) · 24.06.2026 · 10 (3) · 814-824

DOI: 10.29207/resti.v10i3.7681 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi), online erschienen am 24.06.2026. Verfasst von Muhammad Alkaff und 4 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Hate speech detection on Indonesian social media remains challenging due to the coexistence of formal and highly colloquial language, as well as the moderate class imbalance typical of real-world datasets. Models trained under these conditions often skew toward the majority class and generalize poorly across linguistic registers. This study investigates whether a simple, training-free model-level ensemble can improve Indonesian hate speech detection under such conditions without resampling the data. IndoBERTweet and IndoRoBERTa, pretrained respectively on informal Twitter text and broader formal corpora, serve as complementary base models, and their class probabilities are combined through equal-weight soft voting. On the Indonesian Hate Speech Superset (N = 14,306), evaluated across five random seeds with paired significance testing, the soft-voting ensemble attains a macro-averaged F1 of 0.898 ± 0.003 and a macro recall of 0.899 ± 0.003. It significantly outperforms a TF-IDF SVM baseline and the IndoRoBERTa base model, while showing no significant difference from the stronger IndoBERTweet base model and a trained logistic-regression stacking ensemble. Notably, the ensemble matches the stacking ensemble without any additional training stage or meta-learner, and a calibration analysis shows it improves probability calibration over both base models. These results indicate that equal-weight probability averaging is a simple, reproducible, and competitive strategy for Indonesian hate speech detection under moderate class imbalance.

Zitieren

APA

Alkaff, M., Wijaya, E. S., Fadliyanur, F., Bahit, M., & Ilyasa, S. N. (2026). Indonesian Hate Speech Detection under Class Imbalance Using a Soft-Voting Ensemble of IndoBERTweet and IndoRoBERTa. Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi), 10(3), 814-824. https://doi.org/10.29207/resti.v10i3.7681

Vancouver

Alkaff M, Wijaya ES, Fadliyanur F, Bahit M, Ilyasa SN. Indonesian Hate Speech Detection under Class Imbalance Using a Soft-Voting Ensemble of IndoBERTweet and IndoRoBERTa. Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi). 2026;10(3):814-824. doi:10.29207/resti.v10i3.7681

BibTeX
@article{Alkaff2026,
  author = {Alkaff, Muhammad and Wijaya, Eka Setya and Fadliyanur, Fadliyanur and Bahit, Muhammad and Ilyasa, Sinar Nadhif},
  title = {Indonesian Hate Speech Detection under Class Imbalance Using a Soft-Voting Ensemble of IndoBERTweet and IndoRoBERTa},
  journal = {Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi)},
  year = {2026},
  volume = {10},
  number = {3},
  pages = {814--824},
  doi = {10.29207/resti.v10i3.7681}
}
Kostenlos starten →