Reliability of Outcome Monitoring Indices After Effort Exertion: A Psychometric Evaluation of the Effort‐Doors Task for the Study of Individual Differences
Psychophysiology · 2026
DOI: 10.1111/psyp.70372 ↗Kurz gefasst
Fachartikel in der Zeitschrift Psychophysiology, 2026. Verfasst von Gavin Heindorf und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychology, University of South Florida, Tampa, Florida, USA. Hauptthemen laut MEDLINE: Psychometrics, Individuality, Evoked Potentials, Reward. Die Arbeit nennt 84 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: NIMH NIH HHS, National Institute of Mental Health.
Abstract (Originalsprache)
The effort‐doors task was developed to advance the study of individual differences in effort‐reward dynamics by eliciting neural indices across multiple stages of outcome monitoring. The task's suitability for between‐person inferences depends on the psychometric reliability of the scores it produces. Generalizability theory was used to evaluate the psychometric properties of the raw event‐related brain potential (ERP) scores and their subtraction‐based composites that are obtained from an extended version of the effort‐doors task. An equation for estimating the reliability of a difference‐of‐differences score was derived and applied to estimate reliability and trial‐count requirements at prespecified thresholds in a sample of 160 participants. The raw scores of cue‐P3, reward positivity (RewP), and feedback‐P3 (fb‐P3) all achieved the recommended reliability threshold for between‐person analyses. However, an effect of effort was observed only for cue‐P3 (i.e., cue reactivity). The stimulus‐preceding negativity (SPN) showed inadequate reliability; improved data quality or additional trials may increase reliability, although the projected trial requirement should be weighed against feasibility. Most raw scores from the 120‐trial task were sufficiently reliable for between‐person analyses. However, SPN reliability was inadequate, effort effects were not credible for SPN, RewP, or fb‐P3, and fb‐P3 did not vary by feedback valence. These limitations should be considered in relation to theory and alternative paradigms. Overall, the 120‐trial version of the effort‐doors task can support individual‐differences research focused on raw ERP indices across most stages of outcome monitoring, whereas individual differences in effort‐related, valence‐related, or effort‐by‐valence modulation should not be inferred from subtraction‐based scores without further optimization and demonstrated reliability.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Psychology, University of South Florida, Tampa, Florida, USA.
- Department of Psychological and Quantitative Foundations, University of Iowa, Iowa City, Iowa, USA.
ORCID-Profile: Harold A Rocha, Walter P Vispoel, Peter E Clayson
Förderung
- NIMH NIH HHS
- National Institute of Mental Health
Zitieren
APA
Heindorf, G., Rocha, H. A., Chen, T., Vispoel, W. P., & Clayson, P. E. (2026). Reliability of Outcome Monitoring Indices After Effort Exertion: A Psychometric Evaluation of the Effort‐Doors Task for the Study of Individual Differences. Psychophysiology. https://doi.org/10.1111/psyp.70372
Vancouver
Heindorf G, Rocha HA, Chen T, Vispoel WP, Clayson PE. Reliability of Outcome Monitoring Indices After Effort Exertion: A Psychometric Evaluation of the Effort‐Doors Task for the Study of Individual Differences. Psychophysiology. 2026. doi:10.1111/psyp.70372
BibTeX
@article{Heindorf2026,
author = {Heindorf, Gavin and Rocha, Harold A and Chen, Tingting and Vispoel, Walter P and Clayson, Peter E},
title = {Reliability of Outcome Monitoring Indices After Effort Exertion: A Psychometric Evaluation of the Effort‐Doors Task for the Study of Individual Differences},
journal = {Psychophysiology},
year = {2026},
doi = {10.1111/psyp.70372}
}
EUVIMED