Prompting the Machine: Introducing an LLM Data Extraction Method for Social Scientists
Social Science Computer Review · 2026-06 · 44 (3) · 428-441
DOI: 10.1177/08944393251344865 ↗Kurz gefasst
Fachartikel in der Zeitschrift Social Science Computer Review, online erschienen am 27.05.2025. Verfasst von Laurence-Olivier M. Foisy und 6 weiteren Autor:innen. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 37 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
This research note addresses a methodological gap in the study of large language models (LLMs) in social sciences: the absence of standardized data extraction procedures. While existing research has examined biases and the reliability of LLM-generated content, the establishment of transparent extraction protocols necessarily precedes substantive analysis. The paper introduces a replicable procedural framework for extracting structured political data from LLMs via API, designed to enhance transparency, accessibility, and reproducibility. Canadian federal and Quebec provincial politicians serve as an illustrative case to demonstrate the extraction methodology, encompassing prompt engineering, output processing, and error handling mechanisms. The procedure facilitates systematic data collection across multiple LLM versions, enabling inter-model comparisons while addressing extraction challenges such as response variability and malformed outputs. The contribution is primarily methodological—providing researchers with a foundational extraction protocol adaptable to diverse research contexts. This standardized approach constitutes an essential preliminary step for subsequent evaluation of LLM-generated content, establishing procedural clarity in this methodologically developing research domain.
Zitieren
APA
Foisy, L. M., Proulx, É., Cadieux, H., Gilbert, J., Rivest, J., Bouillon, A., & Dufresne, Y. (2026). Prompting the Machine: Introducing an LLM Data Extraction Method for Social Scientists. Social Science Computer Review, 44(3), 428-441. https://doi.org/10.1177/08944393251344865
Vancouver
Foisy LM, Proulx É, Cadieux H, Gilbert J, Rivest J, Bouillon A, et al. Prompting the Machine: Introducing an LLM Data Extraction Method for Social Scientists. Social Science Computer Review. 2026;44(3):428-441. doi:10.1177/08944393251344865
BibTeX
@article{Foisy2026,
author = {Foisy, Laurence-Olivier M. and Proulx, Étienne and Cadieux, Hubert and Gilbert, Jérémy and Rivest, Jozef and Bouillon, Alexandre and Dufresne, Yannick},
title = {Prompting the Machine: Introducing an LLM Data Extraction Method for Social Scientists},
journal = {Social Science Computer Review},
year = {2026},
volume = {44},
number = {3},
pages = {428--441},
doi = {10.1177/08944393251344865}
}
EUVIMED