EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

When Correlation Is Not Enough: Validating Populism Scores from Supervised Machine-Learning Models

Michael Jankowski, Robert A. Huber

Political Analysis · 2023-10 · 31 (4) · 591-605

DOI: 10.1017/pan.2022.32 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Political Analysis, online erschienen am 09.01.2023. Verfasst von Michael Jankowski und 1 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Despite the ongoing success of populist parties in many parts of the world, we lack comprehensive information about parties’ level of populism over time. A recent contribution to Political Analysis by Di Cocco and Monechi (DCM) suggests that this research gap can be closed by predicting parties’ populism scores from their election manifestos using supervised machine learning. In this paper, we provide a detailed discussion of the suggested approach. Building on recent debates about the validation of machine-learning models, we argue that the validity checks provided in DCM’s paper are insufficient. We conduct a series of additional validity checks and empirically demonstrate that the approach is not suitable for deriving populism scores from texts. We conclude that measuring populism over time and between countries remains an immense challenge for empirical research. More generally, our paper illustrates the importance of more comprehensive validations of supervised machine-learning models.

Zitieren

APA

Jankowski, M., & Huber, R. A. (2023). When Correlation Is Not Enough: Validating Populism Scores from Supervised Machine-Learning Models. Political Analysis, 31(4), 591-605. https://doi.org/10.1017/pan.2022.32

Vancouver

Jankowski M, Huber RA. When Correlation Is Not Enough: Validating Populism Scores from Supervised Machine-Learning Models. Political Analysis. 2023;31(4):591-605. doi:10.1017/pan.2022.32

BibTeX
@article{Jankowski2023,
  author = {Jankowski, Michael and Huber, Robert A.},
  title = {When Correlation Is Not Enough: Validating Populism Scores from Supervised Machine-Learning Models},
  journal = {Political Analysis},
  year = {2023},
  volume = {31},
  number = {4},
  pages = {591--605},
  doi = {10.1017/pan.2022.32}
}
Kostenlos starten →