EUVIMEDEUVIMED entdecken
Open Access · CC BY-SA 4.0

Evaluating Audience Perception in Indonesian Animation: Comparative Aspect-Based Sentiment Analysis Using Random Forest and IndoBERT

Eko Rahmat Slamet Hidayat Saputra, Arvin Claudy Frobenius

Journal of Information Technology, Software Engineering and Computer Science (ITSECS) · 31.07.2026 · 4 (3) · 25-38

DOI: 10.58602/itsecs.v4i3.353 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Information Technology, Software Engineering and Computer Science (ITSECS), online erschienen am 31.07.2026. Verfasst von Eko Rahmat Slamet Hidayat Saputra und 1 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-SA 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The rapid expansion of the Indonesian animation industry has sparked vibrant public discourse on social media, yet existing research primarily focuses on binary or overall sentiment rather than fine-grained aspect-level evaluations. This study presents an aspect-based sentiment analysis (ABSA) comparing a traditional machine learning baseline (Random Forest with TF-IDF and SMOTE) against a deep learning model (fine-tuned IndoBERT) on 2,759 tweets discussing domestic animated films Jumbo and Merah Putih: One For All (MPOA). An 11-class joint aspect-sentiment classification scheme was established using a semi-automated annotation pipeline, achieving almost perfect inter-annotator agreement (Cohen’s Kappa κ = 0.8616). Experimental results demonstrate that fine-tuned IndoBERT significantly outperformed the Random Forest baseline, increasing accuracy from 40.16% to 51.64% (+11.48 percentage points) and weighted F1-score from 36.60% to 45.69% (+24.8% relative gain). Corpus-wide aspect distribution revealed that general film evaluation dominates social media discussion (95.9%), followed by animation quality (1.9%) and storyline (1.6%). Furthermore, sentiment analysis uncovered contrasting reception patterns: Jumbo attained overwhelmingly positive net sentiment (+63.8%), whereas MPOA faced severe negative backlash (−46.2%) driven by technical animation critiques and public controversies. Despite overall performance constraints caused by severe class imbalance and limited training data, these findings confirm the superiority of pre-trained Transformer architectures for complex multi-class ABSA tasks in low-resource Indonesian social media text.

Zitieren

APA

Saputra, E. R. S. H., & Frobenius, A. C. (2026). Evaluating Audience Perception in Indonesian Animation: Comparative Aspect-Based Sentiment Analysis Using Random Forest and IndoBERT. Journal of Information Technology, Software Engineering and Computer Science (ITSECS), 4(3), 25-38. https://doi.org/10.58602/itsecs.v4i3.353

Vancouver

Saputra ERSH, Frobenius AC. Evaluating Audience Perception in Indonesian Animation: Comparative Aspect-Based Sentiment Analysis Using Random Forest and IndoBERT. Journal of Information Technology, Software Engineering and Computer Science (ITSECS). 2026;4(3):25-38. doi:10.58602/itsecs.v4i3.353

BibTeX
@article{Saputra2026,
  author = {Saputra, Eko Rahmat Slamet Hidayat and Frobenius, Arvin Claudy},
  title = {Evaluating Audience Perception in Indonesian Animation: Comparative Aspect-Based Sentiment Analysis Using Random Forest and IndoBERT},
  journal = {Journal of Information Technology, Software Engineering and Computer Science (ITSECS)},
  year = {2026},
  volume = {4},
  number = {3},
  pages = {25--38},
  doi = {10.58602/itsecs.v4i3.353}
}
Kostenlos starten →