Evaluating TF-IDF With Logistic Regression and BERT Fine-Tuning for Movie Review Sentiment Analysis
Frontiers in Computing and Intelligent Systems · 27.03.2026 · 16 (1) · 12-18
DOI: 10.54097/bs3z2870 ↗Kurz gefasst
Fachartikel in der Zeitschrift Frontiers in Computing and Intelligent Systems, online erschienen am 27.03.2026. Verfasst von Bowen Guo. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
Understanding how people express opinions online is crucial for application such as public sentiment analysis social media monitoring and opinion-based decision making, yet sentiment analysis still faces difficulties due to the flexible, diverse, and often ambiguous use of language in user-generated content. In this study, we compare two distinct approaches: a conventional TF-IDF model combined with Logistic Regression, and a neural approach that fine-tunes BERT. Experiments were performed on the IMDb dataset containing 50,000 movie reviews, which is evenly split between positive and negative samples. We compared a simple TF-IDF model with logistic regression against a fine-tuned BERT using the AdamW optimiser and early stopping. The BERT model gave a slightly higher Macro-F1 (0.9146 ± 0.0041) than the baseline (0.9084). The improvement seems to come from its better handling of subtle or implied sentiment. Still, the traditional model remains surprisingly strong on a balanced dataset, suggesting that simpler models can still be valuable for sentiment analysis tasks.
Zitieren
APA
Guo, B. (2026). Evaluating TF-IDF With Logistic Regression and BERT Fine-Tuning for Movie Review Sentiment Analysis. Frontiers in Computing and Intelligent Systems, 16(1), 12-18. https://doi.org/10.54097/bs3z2870
Vancouver
Guo B. Evaluating TF-IDF With Logistic Regression and BERT Fine-Tuning for Movie Review Sentiment Analysis. Frontiers in Computing and Intelligent Systems. 2026;16(1):12-18. doi:10.54097/bs3z2870
BibTeX
@article{Guo2026,
author = {Guo, Bowen},
title = {Evaluating TF-IDF With Logistic Regression and BERT Fine-Tuning for Movie Review Sentiment Analysis},
journal = {Frontiers in Computing and Intelligent Systems},
year = {2026},
volume = {16},
number = {1},
pages = {12--18},
doi = {10.54097/bs3z2870}
}
EUVIMED