When Correlation Is Not Enough: Validating Populism Scores from Supervised Machine-Learning Models
Political Analysis · 2023-10 · 31 (4) · 591-605
DOI: 10.1017/pan.2022.32 ↗Kurz gefasst
Fachartikel in der Zeitschrift Political Analysis, online erschienen am 09.01.2023. Verfasst von Michael Jankowski und 1 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Despite the ongoing success of populist parties in many parts of the world, we lack comprehensive information about parties’ level of populism over time. A recent contribution to Political Analysis by Di Cocco and Monechi (DCM) suggests that this research gap can be closed by predicting parties’ populism scores from their election manifestos using supervised machine learning. In this paper, we provide a detailed discussion of the suggested approach. Building on recent debates about the validation of machine-learning models, we argue that the validity checks provided in DCM’s paper are insufficient. We conduct a series of additional validity checks and empirically demonstrate that the approach is not suitable for deriving populism scores from texts. We conclude that measuring populism over time and between countries remains an immense challenge for empirical research. More generally, our paper illustrates the importance of more comprehensive validations of supervised machine-learning models.
Zitieren
APA
Jankowski, M., & Huber, R. A. (2023). When Correlation Is Not Enough: Validating Populism Scores from Supervised Machine-Learning Models. Political Analysis, 31(4), 591-605. https://doi.org/10.1017/pan.2022.32
Vancouver
Jankowski M, Huber RA. When Correlation Is Not Enough: Validating Populism Scores from Supervised Machine-Learning Models. Political Analysis. 2023;31(4):591-605. doi:10.1017/pan.2022.32
BibTeX
@article{Jankowski2023,
author = {Jankowski, Michael and Huber, Robert A.},
title = {When Correlation Is Not Enough: Validating Populism Scores from Supervised Machine-Learning Models},
journal = {Political Analysis},
year = {2023},
volume = {31},
number = {4},
pages = {591--605},
doi = {10.1017/pan.2022.32}
}
EUVIMED