Impact of ERP Reliability Cutoffs on Sample Characteristics and Effect Sizes: Performance‐Monitoring ERPs in Psychosis and Healthy Controls
Psychophysiology · 2025
DOI: 10.1111/psyp.14758 ↗Kurz gefasst
Fachartikel in der Zeitschrift Psychophysiology, 2025. Verfasst von Gavin Heindorf und 7 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychology, University of South Florida, Tampa, Florida, USA. Hauptthemen laut MEDLINE: Evoked Potentials, Psychotic Disorders, Electroencephalography, Psychomotor Performance. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 110 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: VISN-22 Mental Illness Research Education and Clinical Center, NIMH NIH HHS, National Institute of Mental Health.
Abstract (Originalsprache)
In studies of event‐related brain potentials (ERPs), it is common practice to exclude participants for having too few trials for analysis to ensure adequate score reliability (i.e., internal consistency). However, in research involving clinical samples, the impact of increasingly rigorous reliability standards on factors such as sample generalizability, patient versus control effect sizes, and effect sizes for within‐group correlations with external variables is unclear. This study systematically evaluated whether different ERP reliability cutoffs impacted these factors in psychosis. Error‐related negativity (ERN) and error positivity (Pe) were assessed during a modified flanker task in 97 patients with psychosis and 104 healthy comparison participants, who also completed measures of cognition and psychiatric symptoms. ERP reliability cutoffs had notably different effects on the factors considered. A recommended reliability cutoff of 0.80 resulted in sample bias due to systematic exclusion of patients with relatively few task errors, lower reported psychiatric symptoms, and higher levels of cognitive functioning. ERP score reliability lower than 0.80 resulted in generally smaller between‐ and within‐group effect sizes, likely misrepresenting effect sizes. Imposing rigorous ERP reliability standards in studies of psychotic disorders might exclude high‐functioning patients, which raises important considerations for the generalizability of clinical ERP research. Moving forward, we recommend examining characteristics of excluded participants, optimizing paradigms and processing pipelines for use in clinical samples, justifying reliability thresholds, and routinely reporting score reliability of all measurements, ERP or otherwise, used to examine individual differences, especially in clinical research.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Psychology, University of South Florida, Tampa, Florida, USA.
- VISN 22 Mental Illness Research, Education & Clinical Center (MIRECC), San Diego VA Healthcare System, San Diego, California, USA.
- Department of Psychiatry, University of California San Diego, San Diego, California, USA.
- Department of Psychology, University of California - Davis, Davis, California, USA.
- Department of Psychological Services, Purdue University, West Lafayette, Indiana, USA.
- Department of Psychiatry, Stony Brook University, Stony Brook, New York, USA.
ORCID-Profile: Amanda Holbrook, Bohyun Park, Gregory A Light, Philippe Rast, Dan Foti, Peter E Clayson
Förderung
- VISN-22 Mental Illness Research Education and Clinical Center
- NIMH NIH HHS
- National Institute of Mental Health
Zitieren
APA
Heindorf, G., Holbrook, A., Park, B., Light, G. A., Rast, P., Foti, D., Kotov, R., & Clayson, P. E. (2025). Impact of ERP Reliability Cutoffs on Sample Characteristics and Effect Sizes: Performance‐Monitoring ERPs in Psychosis and Healthy Controls. Psychophysiology. https://doi.org/10.1111/psyp.14758
Vancouver
Heindorf G, Holbrook A, Park B, Light GA, Rast P, Foti D, et al. Impact of ERP Reliability Cutoffs on Sample Characteristics and Effect Sizes: Performance‐Monitoring ERPs in Psychosis and Healthy Controls. Psychophysiology. 2025. doi:10.1111/psyp.14758
BibTeX
@article{Heindorf2025,
author = {Heindorf, Gavin and Holbrook, Amanda and Park, Bohyun and Light, Gregory A and Rast, Philippe and Foti, Dan and Kotov, Roman and Clayson, Peter E},
title = {Impact of ERP Reliability Cutoffs on Sample Characteristics and Effect Sizes: Performance‐Monitoring ERPs in Psychosis and Healthy Controls},
journal = {Psychophysiology},
year = {2025},
doi = {10.1111/psyp.14758}
}
EUVIMED