EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Does Bigger Mean Better? A Domain-Aware Comparison of Lexicon-Based, TF-IDF, and Transformer Models for Sentiment Analysis

Muhammad Abbas, Shujat Hussain, Ahmad Sami Al-Shamayleh, Ghulam Mustafa, Azam Mehmood, Isabel De la Torre Díez, Mónica Gracia Villar, Helena Garay

Computation · 05.11.2026 · 14 (11) · 278

DOI: 10.3390/computation14110278 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Computation, online erschienen am 05.11.2026. Verfasst von Muhammad Abbas und 7 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Sentiment analysis systems range from training-free lexicons to compact supervised models and fine-tuned transformer encoders, but fair comparison requires identical test examples and explicit computational accounting. (1)

Background

We reassess three sentiment-classification paradigms under matched binary-label evaluation on IMDb movie reviews and Sentiment140 tweets. (2)

Methods

After duplicate and label audits, VADER, TF–IDF with validation-tuned Logistic Regression, and three-epoch GPU-fine-tuned DistilBERT were evaluated on the same 5065 IMDb and 10,000 Sentiment140 held-out records within each corpus. Accuracy, macro-F1, confusion matrices, paired McNemar tests, bootstrap intervals, training time, and inference throughput were computed from saved predictions and execution logs. (3)

Results

DistilBERT reached 92.00% accuracy on IMDb and 83.41% on Sentiment140, compared with 91.06% and 78.77% for Logistic Regression and 69.83% and 66.54% for VADER. DistilBERT exceeded Logistic Regression by 0.95 percentage points on IMDb (paired 95% CI 0.08–1.76; p=0.0351) and by 4.64 points on Sentiment140 (CI 3.85–5.41; p

Zitieren

APA

Abbas, M., Hussain, S., Al-Shamayleh, A. S., Mustafa, G., Mehmood, A., Díez, I. D. L. T., Villar, M. G., & Garay, H. (2026). Does Bigger Mean Better? A Domain-Aware Comparison of Lexicon-Based, TF-IDF, and Transformer Models for Sentiment Analysis. Computation, 14(11), 278. https://doi.org/10.3390/computation14110278

Vancouver

Abbas M, Hussain S, Al-Shamayleh AS, Mustafa G, Mehmood A, Díez IDLT, et al. Does Bigger Mean Better? A Domain-Aware Comparison of Lexicon-Based, TF-IDF, and Transformer Models for Sentiment Analysis. Computation. 2026;14(11):278. doi:10.3390/computation14110278

BibTeX
@article{Abbas2026,
  author = {Abbas, Muhammad and Hussain, Shujat and Al-Shamayleh, Ahmad Sami and Mustafa, Ghulam and Mehmood, Azam and Díez, Isabel De la Torre and Villar, Mónica Gracia and Garay, Helena},
  title = {Does Bigger Mean Better? A Domain-Aware Comparison of Lexicon-Based, TF-IDF, and Transformer Models for Sentiment Analysis},
  journal = {Computation},
  year = {2026},
  volume = {14},
  number = {11},
  pages = {278},
  doi = {10.3390/computation14110278}
}
Kostenlos starten →