Sentiment Classification of Health Education YouTube Comments Using IndoBERT Embeddings with Logistic Regression and Naïve Bayes
Journal of Applied Informatics and Computing · 18.06.2026 · 10 (3) · 3005-3020
DOI: 10.30871/jaic.v10i3.13016 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Applied Informatics and Computing, online erschienen am 18.06.2026. Verfasst von Andre Septa Wijaya und 2 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-SA 4.0).
Abstract (Originalsprache)
Class imbalance is a common issue in sentiment classification of social media data, particularly in mental health–related discussions where certain sentiment classes are underrepresented. This study focuses on sentiment classification of mental health–related YouTube comments by utilizing IndoBERT as a pre-trained language model to generate contextual text embeddings. Sentiment classification is subsequently performed using conventional machine learning algorithms, namely Logistic Regression and Naïve Bayes. The research framework includes data collection through the YouTube Data API, text preprocessing, semi-manual sentiment labeling into positive, neutral, and negative classes, and dataset partitioning using an 80:20 train–test split. To address class imbalance, the Synthetic Minority Over-sampling Technique (SMOTE) is applied exclusively to the training data to prevent data leakage. Feature representation is obtained from IndoBERT embeddings with a dimensionality of 768. Model performance is evaluated using accuracy, precision, recall, and F1-score. Experimental results show that Logistic Regression outperforms Naïve Bayes, achieving an accuracy of 78%, compared to 56% for Naïve Bayes. This indicates that Logistic Regression is more effective in handling dense contextual embeddings generated by transformer-based models. Overall, the findings demonstrate that combining contextual embeddings with data balancing techniques can improve sentiment classification performance in mental health–related social media analysis, particularly in low-resource language settings.
Zitieren
APA
Wijaya, A. S., Fahmi, A., & Pramudi, Y. T. C. (2026). Sentiment Classification of Health Education YouTube Comments Using IndoBERT Embeddings with Logistic Regression and Naïve Bayes. Journal of Applied Informatics and Computing, 10(3), 3005-3020. https://doi.org/10.30871/jaic.v10i3.13016
Vancouver
Wijaya AS, Fahmi A, Pramudi YTC. Sentiment Classification of Health Education YouTube Comments Using IndoBERT Embeddings with Logistic Regression and Naïve Bayes. Journal of Applied Informatics and Computing. 2026;10(3):3005-3020. doi:10.30871/jaic.v10i3.13016
BibTeX
@article{Wijaya2026,
author = {Wijaya, Andre Septa and Fahmi, Amiq and Pramudi, Yuventius Tyas Catur},
title = {Sentiment Classification of Health Education YouTube Comments Using IndoBERT Embeddings with Logistic Regression and Naïve Bayes},
journal = {Journal of Applied Informatics and Computing},
year = {2026},
volume = {10},
number = {3},
pages = {3005--3020},
doi = {10.30871/jaic.v10i3.13016}
}
EUVIMED