Does Bigger Mean Better? A Domain-Aware Comparison of Lexicon-Based, TF-IDF, and Transformer Models for Sentiment Analysis
Computation · 05.11.2026 · 14 (11) · 278
DOI: 10.3390/computation14110278 ↗Kurz gefasst
Fachartikel in der Zeitschrift Computation, online erschienen am 05.11.2026. Verfasst von Muhammad Abbas und 7 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Sentiment analysis systems range from training-free lexicons to compact supervised models and fine-tuned transformer encoders, but fair comparison requires identical test examples and explicit computational accounting. (1)
Background
We reassess three sentiment-classification paradigms under matched binary-label evaluation on IMDb movie reviews and Sentiment140 tweets. (2)
Methods
After duplicate and label audits, VADER, TF–IDF with validation-tuned Logistic Regression, and three-epoch GPU-fine-tuned DistilBERT were evaluated on the same 5065 IMDb and 10,000 Sentiment140 held-out records within each corpus. Accuracy, macro-F1, confusion matrices, paired McNemar tests, bootstrap intervals, training time, and inference throughput were computed from saved predictions and execution logs. (3)
Results
DistilBERT reached 92.00% accuracy on IMDb and 83.41% on Sentiment140, compared with 91.06% and 78.77% for Logistic Regression and 69.83% and 66.54% for VADER. DistilBERT exceeded Logistic Regression by 0.95 percentage points on IMDb (paired 95% CI 0.08–1.76; p=0.0351) and by 4.64 points on Sentiment140 (CI 3.85–5.41; p
Zitieren
APA
Abbas, M., Hussain, S., Al-Shamayleh, A. S., Mustafa, G., Mehmood, A., Díez, I. D. L. T., Villar, M. G., & Garay, H. (2026). Does Bigger Mean Better? A Domain-Aware Comparison of Lexicon-Based, TF-IDF, and Transformer Models for Sentiment Analysis. Computation, 14(11), 278. https://doi.org/10.3390/computation14110278
Vancouver
Abbas M, Hussain S, Al-Shamayleh AS, Mustafa G, Mehmood A, Díez IDLT, et al. Does Bigger Mean Better? A Domain-Aware Comparison of Lexicon-Based, TF-IDF, and Transformer Models for Sentiment Analysis. Computation. 2026;14(11):278. doi:10.3390/computation14110278
BibTeX
@article{Abbas2026,
author = {Abbas, Muhammad and Hussain, Shujat and Al-Shamayleh, Ahmad Sami and Mustafa, Ghulam and Mehmood, Azam and Díez, Isabel De la Torre and Villar, Mónica Gracia and Garay, Helena},
title = {Does Bigger Mean Better? A Domain-Aware Comparison of Lexicon-Based, TF-IDF, and Transformer Models for Sentiment Analysis},
journal = {Computation},
year = {2026},
volume = {14},
number = {11},
pages = {278},
doi = {10.3390/computation14110278}
}
EUVIMED