Comparing Sentiment Labeling with RoBERTa and IndoBERTweet on Public Opinion of Program Makan Bergizi Gratis
Indonesian Journal of Data and Science · 31.03.2026 · 7 (1) · 105-118
DOI: 10.56705/ijodas.v7i1.381 ↗Kurz gefasst
Fachartikel in der Zeitschrift Indonesian Journal of Data and Science, online erschienen am 31.03.2026. Verfasst von Putri Nur Rezky und 2 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
The Program Makan Bergizi Gratis (MBG) is a flagship program of the Prabowo Subianto administration launched in 2024, triggering diverse public responses on social media. Sentiment analysis using deep learning models offers an effective approach to understanding public opinion at scale. However, selecting the appropriate model for Indonesian social media text remains challenging. This study aims to compare the performance of two pretrained transformer models, RoBERTa Base and IndoBERTweet Base, in conducting automatic sentiment labeling on Indonesian tweets related to the MBG program using a zero-shot labeling approach without human-annotated ground truth. A total of 1,831 tweets were collected from platform X and preprocessed using case folding, normalization, and stopword removal. Both models were applied in parallel to label each tweet with sentiment categories (positive, neutral, negative) along with confidence scores. The comparison was evaluated using agreement rate, Cohen's Kappa, and confidence score analysis. RoBERTa Base exhibits a conservative tendency with 75.20% neutral labels, while IndoBERTweet Base produces a more balanced distribution (68.16% neutral). The comparison shows 77.28% agreement with Cohen's Kappa of 0.490 (Moderate Agreement). RoBERTa Base achieves higher confidence (mean: 0.9559, 83.01% above 0.95) compared to IndoBERTweet Base (mean: 0.9236, 68.65% above 0.95). IndoBERTweet Base is more effective in detecting negative sentiment, identifying nearly twice as many negative tweets (13.54% vs. 7.48%). This study recommends IndoBERTweet Base for exploratory research requiring sensitive sentiment detection and RoBERTa Base for precision-critical applications. An ensemble approach combining both models is recommended for production-critical applications
Zitieren
APA
Rezky, P. N., Indra, D., & Herdianti (2026). Comparing Sentiment Labeling with RoBERTa and IndoBERTweet on Public Opinion of Program Makan Bergizi Gratis. Indonesian Journal of Data and Science, 7(1), 105-118. https://doi.org/10.56705/ijodas.v7i1.381
Vancouver
Rezky PN, Indra D, Herdianti. Comparing Sentiment Labeling with RoBERTa and IndoBERTweet on Public Opinion of Program Makan Bergizi Gratis. Indonesian Journal of Data and Science. 2026;7(1):105-118. doi:10.56705/ijodas.v7i1.381
BibTeX
@article{Rezky2026,
author = {Rezky, Putri Nur and Indra, Dolly and Herdianti},
title = {Comparing Sentiment Labeling with RoBERTa and IndoBERTweet on Public Opinion of Program Makan Bergizi Gratis},
journal = {Indonesian Journal of Data and Science},
year = {2026},
volume = {7},
number = {1},
pages = {105--118},
doi = {10.56705/ijodas.v7i1.381}
}
EUVIMED