HATE SPEECH CLASSIFICATION IN LOW RESOURCE REGIONAL LANGUAGESUSING CROSS LINGUAL TRANSFER LEARNING AND LLM BASED DATA AUGMENTATION
JURNAL TEKNISI · 2026
DOI: 10.54314/ma09f535 ↗Kurz gefasst
Fachartikel in der Zeitschrift JURNAL TEKNISI, 2026. Verfasst von Vira Aditya und 1 weiteren Autor:innen. Die Arbeit nennt 22 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-SA 4.0).
Abstract (Originalsprache)
Hate speech on social media in Indonesia is often written in regional languages, which automatic moderation systems largely ignore because annotated data are scarce. This study builds a new annotated corpus of 6,000 social media comments in Batak Toba (BT) and Melayu Deli (MD), labelled as hate speech, abusive, or neutral by native speakers with substantial agreement (Fleiss’ κ = 0.71 for BT and 0.74 for MD). Two pre-trained models, IndoBERT and XLM-RoBERTa (XLM-R), were evaluated in three scenarios: zero-shot cross-lingual transfer from an Indonesian hate speech dataset, few-shot fine-tuning, and full fine-tuning. A fourth scenario adds synthetic training data generated by a large language model (LLM) and passed through a three-stage filter covering deduplication, label consistency, and native-speaker auditing. XLM-R with full fine-tuning reached a macro-F1 of 76.1% (BT) and 80.9% (MD). Filtered LLM augmentation raised these to 79.4% and 83.1%, outperforming EDA and back-translation, whereas unfiltered synthetic data reduced performance on BT. Keyword: hate speech detection; low-resource languages; cross-lingual transfer; data augmentation; large language model Abstrak: Ujaran kebencian di media sosial Indonesia sering ditulis dalam bahasa daerah, yang sebagian besar diabaikan oleh sistem moderasi otomatis karena data beranotasi sangat terbatas. Penelitian ini membangun korpus beranotasi baru berisi 6.000 komentar media sosial dalam bahasa Batak Toba (BT) dan Melayu Deli (MD), yang dilabeli sebagai ujaran kebencian, kasar, atau netral oleh penutur asli dengan tingkat kesepakatan substansial (Fleiss’ κ = 0,71 untuk BT dan 0,74 untuk MD). Dua model pralatih, IndoBERT dan XLM-RoBERTa (XLM-R), dievaluasi dalam tiga skenario: transfer lintas bahasa zero-shot dari dataset ujaran kebencian berbahasa Indonesia, fine-tuning few-shot, dan fine-tuning penuh. Skenario keempat menambahkan data latih sintetis yang dihasilkan large language model (LLM) dan disaring melalui tiga tahap, yaitu deduplikasi, konsistensi label, dan audit penutur asli. XLM-R dengan fine-tuning penuh mencapai macro-F1 76,1% (BT) dan 80,9% (MD). Augmentasi LLM yang tersaring meningkatkannya menjadi 79,4% dan 83,1%, melampaui EDA dan back-translation, sedangkan data sintetis tanpa penyaringan justru menurunkan performa pada BT. Augmentasi tersaring juga menurunkan false positive rate pada komentar netral yang memuat istilah identitas etnis atau agama dari 18,4% menjadi 15,2% (BT) Kata kunci: deteksi ujaran kebencian; bahasa sumber daya rendah; transfer lintas bahasa; augmentasi data; large language model
Zitieren
APA
Aditya, V., & Awi, Y. (2026). HATE SPEECH CLASSIFICATION IN LOW RESOURCE REGIONAL LANGUAGESUSING CROSS LINGUAL TRANSFER LEARNING AND LLM BASED DATA AUGMENTATION. JURNAL TEKNISI. https://doi.org/10.54314/ma09f535
Vancouver
Aditya V, Awi Y. HATE SPEECH CLASSIFICATION IN LOW RESOURCE REGIONAL LANGUAGESUSING CROSS LINGUAL TRANSFER LEARNING AND LLM BASED DATA AUGMENTATION. JURNAL TEKNISI. 2026. doi:10.54314/ma09f535
BibTeX
@article{Aditya2026,
author = {Aditya, Vira and Awi, Yunita},
title = {HATE SPEECH CLASSIFICATION IN LOW RESOURCE REGIONAL LANGUAGESUSING CROSS LINGUAL TRANSFER LEARNING AND LLM BASED DATA AUGMENTATION},
journal = {JURNAL TEKNISI},
year = {2026},
doi = {10.54314/ma09f535}
}
EUVIMED