Large Language Models for Text Classification: From Zero-Shot Learning to Instruction-Tuning
Sociological Methods & Research · 2026-05 · 55 (2) · 501-567
DOI: 10.1177/00491241251325243 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sociological Methods & Research, online erschienen am 24.04.2025. Verfasst von Youngjin Chae und 1 weiteren Autor:innen. Die Arbeit wurde bisher 53-mal zitiert (Crossref) und nennt 141 Literaturangaben.
Abstract (Originalsprache)
Large language models (LLMs) have tremendous potential for social science research as they are trained on vast amounts of text and can generalize to many tasks. We explore the use of LLMs for supervised text classification, specifically the application to stance detection, which involves detecting attitudes and opinions in texts. We examine the performance of these models across different architectures, training regimes, and task specifications. We compare 10 models ranging in size from tens of millions to hundreds of billions of parameters and test four distinct training regimes: Prompt-based zero-shot learning and few-shot learning, fine-tuning, and instruction-tuning, which combines prompting and fine-tuning. The largest, most powerful models generally offer the best predictive performance even with little or no training examples, but fine-tuning smaller models is a competitive solution due to their relatively high accuracy and low cost. Instruction-tuning the latest generative LLMs expands the scope of text classification, enabling applications to more complex tasks than previously feasible. We offer practical recommendations on the use of LLMs for text classification in sociological research and discuss their limitations and challenges. Ultimately, LLMs can make text classification and other text analysis methods more accurate, accessible, and adaptable, opening new possibilities for computational social science.
Zitieren
APA
Chae, Y., & Davidson, T. (2026). Large Language Models for Text Classification: From Zero-Shot Learning to Instruction-Tuning. Sociological Methods & Research, 55(2), 501-567. https://doi.org/10.1177/00491241251325243
Vancouver
Chae Y, Davidson T. Large Language Models for Text Classification: From Zero-Shot Learning to Instruction-Tuning. Sociological Methods & Research. 2026;55(2):501-567. doi:10.1177/00491241251325243
BibTeX
@article{Chae2026,
author = {Chae, Youngjin and Davidson, Thomas},
title = {Large Language Models for Text Classification: From Zero-Shot Learning to Instruction-Tuning},
journal = {Sociological Methods & Research},
year = {2026},
volume = {55},
number = {2},
pages = {501--567},
doi = {10.1177/00491241251325243}
}
EUVIMED