EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A scalable hybrid framework for sentiment analysis of COVID-19 tweets using transformer embeddings and lightweight classifiers

Zahra Rezaei, Sara Safi Samghabadi, Yaser Mike Banad

PeerJ Computer Science · 25.05.2026 · 12 · e3852

DOI: 10.7717/peerj-cs.3852 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PeerJ Computer Science, online erschienen am 25.05.2026. Verfasst von Zahra Rezaei und 2 weiteren Autor:innen. Die Arbeit nennt 41 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

During the COVID-19 pandemic, Twitter became a key platform for expressing public sentiment. This study explores a simple and scalable way to analyze the sentiment of COVID-19 tweets without the heavy computational cost of full transformer fine-tuning. Pretrained transformer models—Bidirectional Encoder Representations from Transformers (BERT), Distilled Bidirectional Encoder Representations from Transformers (DistilBERT), and Robustly Optimized BERT Pretraining Approach (RoBERTa)—were used in frozen mode to generate sentence embeddings, which were then classified using lightweight models: Support Vector Machine (SVM) and Logistic Regression (LR). On a balanced set of 7,500 labeled tweets from April–June 2020, the best hybrid model DistilBERT embeddings with Logistic Regression reached 0.64 accuracy and 0.62 F1-score (harmonic mean of precision and recall). For comparison, fully fine-tuned transformers on the larger 143,902-tweet dataset achieved up to 0.973 accuracy, zero-shot classifiers scored only 0.21–0.33, VADER reached 0.73, and TextBlob 0.45. The results show that combining frozen transformer embeddings with classical classifiers offers a practical middle ground: it delivers reasonable performance using only a central processing unit (CPU) and minimal training time, making it suitable for research groups or public-health teams with limited computational resources.

Zitieren

APA

Rezaei, Z., Samghabadi, S. S., & Banad, Y. M. (2026). A scalable hybrid framework for sentiment analysis of COVID-19 tweets using transformer embeddings and lightweight classifiers. PeerJ Computer Science, 12, e3852. https://doi.org/10.7717/peerj-cs.3852

Vancouver

Rezaei Z, Samghabadi SS, Banad YM. A scalable hybrid framework for sentiment analysis of COVID-19 tweets using transformer embeddings and lightweight classifiers. PeerJ Computer Science. 2026;12:e3852. doi:10.7717/peerj-cs.3852

BibTeX
@article{Rezaei2026,
  author = {Rezaei, Zahra and Samghabadi, Sara Safi and Banad, Yaser Mike},
  title = {A scalable hybrid framework for sentiment analysis of COVID-19 tweets using transformer embeddings and lightweight classifiers},
  journal = {PeerJ Computer Science},
  year = {2026},
  volume = {12},
  pages = {e3852},
  doi = {10.7717/peerj-cs.3852}
}
Kostenlos starten →