EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Benchmarking QLoRA-Fine-Tuned LLaMA and DeepSeek Models for Sentiment Analysis on Movie Reviews and Twitter Data

Seda Bayat Toksoz, Gultekin Isik

Computational Systems and Artificial Intelligence · 2026

DOI: 10.69882/adba.csai.2026015 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Computational Systems and Artificial Intelligence, 2026. Verfasst von Seda Bayat Toksoz und 1 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Open-weight large language models (LLMs) such as LLaMA 2, LLaMA 3, and DeepSeek have quickly become attractive backbones for downstream NLP tasks, including sentiment analysis in both long-form reviews and short social media posts. However, full fine-tuning of these models remains computationally expensive and often impractical for academic research groups with limited hardware resources. This paper presents a comparative study of QLoRA-based sentiment adaptation for three open-weight LLM families, LLaMA 3, LLaMA 2, and DeepSeek, on two representative English benchmarks: the IMDB movie review dataset and a Twitter sentiment dataset. We apply a unified QLoRA pipeline that quantizes the backbone to 4-bit precision and trains low-rank adapters on top, enabling efficient fine-tuning on a single GPU. LLaMA 3 consistently achieves the best performance across both domains, reaching 91.2% accuracy and 0.908 F1 on IMDB and 85.6% accuracy and 0.849 F1 on Twitter. LLaMA 2 follows closely, while DeepSeek remains competitive but trails by 1–2 percentage points. Confusion matrix analysis reveals that all models struggle more with Twitter data due to its informal language and context-poor nature. Our findings provide practical guidance for practitioners choosing open LLM backbones for sentiment-related applications under compute constraints.

Zitieren

APA

Toksoz, S. B., & Isik, G. (2026). Benchmarking QLoRA-Fine-Tuned LLaMA and DeepSeek Models for Sentiment Analysis on Movie Reviews and Twitter Data. Computational Systems and Artificial Intelligence. https://doi.org/10.69882/adba.csai.2026015

Vancouver

Toksoz SB, Isik G. Benchmarking QLoRA-Fine-Tuned LLaMA and DeepSeek Models for Sentiment Analysis on Movie Reviews and Twitter Data. Computational Systems and Artificial Intelligence. 2026. doi:10.69882/adba.csai.2026015

BibTeX
@article{Toksoz2026,
  author = {Toksoz, Seda Bayat and Isik, Gultekin},
  title = {Benchmarking QLoRA-Fine-Tuned LLaMA and DeepSeek Models for Sentiment Analysis on Movie Reviews and Twitter Data},
  journal = {Computational Systems and Artificial Intelligence},
  year = {2026},
  doi = {10.69882/adba.csai.2026015}
}
Kostenlos starten →