EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-SA 4.0

Performance Comparison Of BERT Metrics and Classical Machine Learning Models (SVM,Naive Bayes) for Sentiment Analysis

Adib Ulinuha El Majid, Reflan Nuari

INOVTEK Polbeng - Seri Informatika · 14.05.2025 · 10 (2) · 741-752

DOI: 10.35314/wmh3rg23 ↗

Kurz gefasst

Fachartikel in der Zeitschrift INOVTEK Polbeng - Seri Informatika, online erschienen am 14.05.2025. Verfasst von Adib Ulinuha El Majid und 1 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY-NC-SA 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Sentiment analysis is one of the important methods in understanding public opinion from large amounts of text, such as product reviews or user comments. Many studies have shown that the BERT (BiDirectional Encoder Representations from Transformers) model has advantages over classical machine learning models such as Support Vector Machine (SVM) and Naïve Bayes. However, there are still few studies that systematically compare the performance of the two on datasets from various topics and languages, especially those with imbalanced label distributions. This study compares four BERT variants (bert-base-uncased, distilbert-base-uncased, indobert-base-uncased, and distilbert-base-indonesian) with two classical models using three datasets of IMDb 50K (English), Amazon Food Reviews (English), and Gojek App Review (Indonesian). The classical model uses the TF-IDF vectorisation method, while the BERT model is optimised through a further training process (fine-tuning) with a layer freezing technique. The evaluation is carried out using accuracy, precision, recall, and F1-score. The results show that the BERT model excels on English data, while on imbalanced Indonesian data, SVM and Naïve Bayes produce higher F1-score results. These findings indicate that the selection of the right model must be adjusted to the characteristics of the data used.

Zitieren

APA

Majid, A. U. E., & Nuari, R. (2025). Performance Comparison Of BERT Metrics and Classical Machine Learning Models (SVM,Naive Bayes) for Sentiment Analysis. INOVTEK Polbeng - Seri Informatika, 10(2), 741-752. https://doi.org/10.35314/wmh3rg23

Vancouver

Majid AUE, Nuari R. Performance Comparison Of BERT Metrics and Classical Machine Learning Models (SVM,Naive Bayes) for Sentiment Analysis. INOVTEK Polbeng - Seri Informatika. 2025;10(2):741-752. doi:10.35314/wmh3rg23

BibTeX
@article{Majid2025,
  author = {Majid, Adib Ulinuha El and Nuari, Reflan},
  title = {Performance Comparison Of BERT Metrics and Classical Machine Learning Models (SVM,Naive Bayes) for Sentiment Analysis},
  journal = {INOVTEK Polbeng - Seri Informatika},
  year = {2025},
  volume = {10},
  number = {2},
  pages = {741--752},
  doi = {10.35314/wmh3rg23}
}
Kostenlos starten →