A tutorial on using generative models to advance psychological science: Lessons from the reliability paradox.
Psychological Methods · 14.04.2025
DOI: 10.1037/met0000674 ↗Kurz gefasst
Fachartikel in der Zeitschrift Psychological Methods, online erschienen am 14.04.2025. Verfasst von Nathaniel Haines und 7 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychology, Ohio State University. Die Arbeit wurde bisher 27-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: NIH HHS, University of Florida; Informatics Institute, Artificial Intelligence Graduate School Program.
Abstract (Originalsprache)
Theories of individual differences are foundational to psychological and brain sciences, yet they are traditionally developed and tested using superficial summaries of data (e.g., mean response times) that are disconnected from our otherwise rich conceptual theories of behavior. To resolve this theory-description gap, we review the generative modeling approach, which involves formally specifying how behavior is generated within individuals, and in turn how generative mechanisms vary across individuals. Generative modeling shifts our focus away from estimating descriptive statistical "effects" toward estimating psychologically interpretable parameters, while simultaneously enhancing the reliability and validity of our measures. We demonstrate the utility of generative modeling in the context of the "reliability paradox," a phenomenon wherein replicable group effects (e.g., Stroop effect) fail to capture individual differences (e.g., low test-retest reliability). Simulations and empirical data from the Implicit Association Test and Stroop, Flanker, Posner, and delay discounting tasks show that generative models yield (a) more theoretically informative parameters, and (b) higher test-retest reliability estimates relative to traditional approaches, illustrating their potential for enhancing theory development. (PsycInfo Database Record (c) 2025 APA, all rights reserved).
Autor:innen und Institutionen
- Department of Psychology, Ohio State University.
- Department of Psychology, University of Florida.
- Department of Psychology, University of Notre Dame.
- Department of Psychology, AI Institute, Seoul National University.
ORCID-Profile: Brandon M Turner
Förderung
- NIH HHS
- University of Florida; Informatics Institute
- Artificial Intelligence Graduate School Program
- Seoul National University; Creative Pioneering Researchers Program
- National Science Foundation
- National Institutes of Health
- University of Florida
- Seoul National University
Zitieren
APA
Haines, N., Kvam, P. D., Irving, L., Smith, C. T., Beauchaine, T. P., Pitt, M. A., Ahn, W. Y., & Turner, B. M. (2025). A tutorial on using generative models to advance psychological science: Lessons from the reliability paradox. Psychological Methods. https://doi.org/10.1037/met0000674
Vancouver
Haines N, Kvam PD, Irving L, Smith CT, Beauchaine TP, Pitt MA, et al. A tutorial on using generative models to advance psychological science: Lessons from the reliability paradox. Psychological Methods. 2025. doi:10.1037/met0000674
BibTeX
@article{Haines2025,
author = {Haines, Nathaniel and Kvam, Peter D and Irving, Louis and Smith, Colin Tucker and Beauchaine, Theodore P and Pitt, Mark A and Ahn, Woo-Young and Turner, Brandon M},
title = {A tutorial on using generative models to advance psychological science: Lessons from the reliability paradox},
journal = {Psychological Methods},
year = {2025},
doi = {10.1037/met0000674}
}
EUVIMED