Performance Comparison Of BERT Metrics and Classical Machine Learning Models (SVM,Naive Bayes) for Sentiment Analysis
INOVTEK Polbeng - Seri Informatika · 14.05.2025 · 10 (2) · 741-752
DOI: 10.35314/wmh3rg23 ↗Kurz gefasst
Fachartikel in der Zeitschrift INOVTEK Polbeng - Seri Informatika, online erschienen am 14.05.2025. Verfasst von Adib Ulinuha El Majid und 1 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY-NC-SA 4.0).
Abstract (Originalsprache)
Sentiment analysis is one of the important methods in understanding public opinion from large amounts of text, such as product reviews or user comments. Many studies have shown that the BERT (BiDirectional Encoder Representations from Transformers) model has advantages over classical machine learning models such as Support Vector Machine (SVM) and Naïve Bayes. However, there are still few studies that systematically compare the performance of the two on datasets from various topics and languages, especially those with imbalanced label distributions. This study compares four BERT variants (bert-base-uncased, distilbert-base-uncased, indobert-base-uncased, and distilbert-base-indonesian) with two classical models using three datasets of IMDb 50K (English), Amazon Food Reviews (English), and Gojek App Review (Indonesian). The classical model uses the TF-IDF vectorisation method, while the BERT model is optimised through a further training process (fine-tuning) with a layer freezing technique. The evaluation is carried out using accuracy, precision, recall, and F1-score. The results show that the BERT model excels on English data, while on imbalanced Indonesian data, SVM and Naïve Bayes produce higher F1-score results. These findings indicate that the selection of the right model must be adjusted to the characteristics of the data used.
Zitieren
APA
Majid, A. U. E., & Nuari, R. (2025). Performance Comparison Of BERT Metrics and Classical Machine Learning Models (SVM,Naive Bayes) for Sentiment Analysis. INOVTEK Polbeng - Seri Informatika, 10(2), 741-752. https://doi.org/10.35314/wmh3rg23
Vancouver
Majid AUE, Nuari R. Performance Comparison Of BERT Metrics and Classical Machine Learning Models (SVM,Naive Bayes) for Sentiment Analysis. INOVTEK Polbeng - Seri Informatika. 2025;10(2):741-752. doi:10.35314/wmh3rg23
BibTeX
@article{Majid2025,
author = {Majid, Adib Ulinuha El and Nuari, Reflan},
title = {Performance Comparison Of BERT Metrics and Classical Machine Learning Models (SVM,Naive Bayes) for Sentiment Analysis},
journal = {INOVTEK Polbeng - Seri Informatika},
year = {2025},
volume = {10},
number = {2},
pages = {741--752},
doi = {10.35314/wmh3rg23}
}
EUVIMED