Toward a framework for creating trustworthy measures with supervised machine learning for text
Political Science Research and Methods · 2026-10 · 14 (4) · 1252-1268
DOI: 10.1017/psrm.2025.10042 ↗Kurz gefasst
Fachartikel in der Zeitschrift Political Science Research and Methods, online erschienen am 29.09.2025. Verfasst von Ju Yeon Park und 1 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Supervised learning is increasingly used in social science research to quantify abstract concepts in textual data. However, a review of recent studies reveals inconsistencies in reporting practices and validation standards. To address this issue, we propose a framework that systematically outlines the process of transforming text into a quantitative measure, emphasizing key reporting decisions at each stage. Clear and comprehensive validation is crucial, enabling readers to critically evaluate both the methodology and the resulting measure. To illustrate our framework, we develop and validate a measure assessing the tone of questions posed to nominees during U.S. Senate confirmation hearings. This study contributes to the growing literature advocating for transparency and rigor in applying machine learning methods within computational social sciences.
Zitieren
APA
Park, J. Y., & Montgomery, J. M. (2026). Toward a framework for creating trustworthy measures with supervised machine learning for text. Political Science Research and Methods, 14(4), 1252-1268. https://doi.org/10.1017/psrm.2025.10042
Vancouver
Park JY, Montgomery JM. Toward a framework for creating trustworthy measures with supervised machine learning for text. Political Science Research and Methods. 2026;14(4):1252-1268. doi:10.1017/psrm.2025.10042
BibTeX
@article{Park2026,
author = {Park, Ju Yeon and Montgomery, Jacob M.},
title = {Toward a framework for creating trustworthy measures with supervised machine learning for text},
journal = {Political Science Research and Methods},
year = {2026},
volume = {14},
number = {4},
pages = {1252--1268},
doi = {10.1017/psrm.2025.10042}
}
EUVIMED