EUVIMEDEUVIMED entdecken
Open Access

Impact of ERP Reliability Cutoffs on Sample Characteristics and Effect Sizes: Performance‐Monitoring ERPs in Psychosis and Healthy Controls

Gavin Heindorf, Amanda Holbrook iD, Bohyun Park iD, Gregory A Light iD, Philippe Rast iD, Dan Foti iD, Roman Kotov, Peter E Clayson iD

Psychophysiology · 2025

DOI: 10.1111/psyp.14758 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Psychophysiology, 2025. Verfasst von Gavin Heindorf und 7 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychology, University of South Florida, Tampa, Florida, USA. Hauptthemen laut MEDLINE: Evoked Potentials, Psychotic Disorders, Electroencephalography, Psychomotor Performance. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 110 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: VISN-22 Mental Illness Research Education and Clinical Center, NIMH NIH HHS, National Institute of Mental Health.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In studies of event‐related brain potentials (ERPs), it is common practice to exclude participants for having too few trials for analysis to ensure adequate score reliability (i.e., internal consistency). However, in research involving clinical samples, the impact of increasingly rigorous reliability standards on factors such as sample generalizability, patient versus control effect sizes, and effect sizes for within‐group correlations with external variables is unclear. This study systematically evaluated whether different ERP reliability cutoffs impacted these factors in psychosis. Error‐related negativity (ERN) and error positivity (Pe) were assessed during a modified flanker task in 97 patients with psychosis and 104 healthy comparison participants, who also completed measures of cognition and psychiatric symptoms. ERP reliability cutoffs had notably different effects on the factors considered. A recommended reliability cutoff of 0.80 resulted in sample bias due to systematic exclusion of patients with relatively few task errors, lower reported psychiatric symptoms, and higher levels of cognitive functioning. ERP score reliability lower than 0.80 resulted in generally smaller between‐ and within‐group effect sizes, likely misrepresenting effect sizes. Imposing rigorous ERP reliability standards in studies of psychotic disorders might exclude high‐functioning patients, which raises important considerations for the generalizability of clinical ERP research. Moving forward, we recommend examining characteristics of excluded participants, optimizing paradigms and processing pipelines for use in clinical samples, justifying reliability thresholds, and routinely reporting score reliability of all measurements, ERP or otherwise, used to examine individual differences, especially in clinical research.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Evoked PotentialsPsychotic DisordersElectroencephalographyPsychomotor PerformanceHumansMaleFemaleAdultReproducibility of ResultsYoung AdultMiddle AgedAdolescent

Stichwörter der Autor:innen

ERP psychometric reliabilitycognitionerror positivity (pe)error‐related negativity (ERN)event‐related potentials (ERPs)psychotic disorders

Autor:innen und Institutionen

  • Department of Psychology, University of South Florida, Tampa, Florida, USA.
  • VISN 22 Mental Illness Research, Education & Clinical Center (MIRECC), San Diego VA Healthcare System, San Diego, California, USA.
  • Department of Psychiatry, University of California San Diego, San Diego, California, USA.
  • Department of Psychology, University of California - Davis, Davis, California, USA.
  • Department of Psychological Services, Purdue University, West Lafayette, Indiana, USA.
  • Department of Psychiatry, Stony Brook University, Stony Brook, New York, USA.

ORCID-Profile: Amanda Holbrook, Bohyun Park, Gregory A Light, Philippe Rast, Dan Foti, Peter E Clayson

Förderung

  • VISN-22 Mental Illness Research Education and Clinical Center
  • NIMH NIH HHS
  • National Institute of Mental Health

Zitieren

APA

Heindorf, G., Holbrook, A., Park, B., Light, G. A., Rast, P., Foti, D., Kotov, R., & Clayson, P. E. (2025). Impact of ERP Reliability Cutoffs on Sample Characteristics and Effect Sizes: Performance‐Monitoring ERPs in Psychosis and Healthy Controls. Psychophysiology. https://doi.org/10.1111/psyp.14758

Vancouver

Heindorf G, Holbrook A, Park B, Light GA, Rast P, Foti D, et al. Impact of ERP Reliability Cutoffs on Sample Characteristics and Effect Sizes: Performance‐Monitoring ERPs in Psychosis and Healthy Controls. Psychophysiology. 2025. doi:10.1111/psyp.14758

BibTeX
@article{Heindorf2025,
  author = {Heindorf, Gavin and Holbrook, Amanda and Park, Bohyun and Light, Gregory A and Rast, Philippe and Foti, Dan and Kotov, Roman and Clayson, Peter E},
  title = {Impact of ERP Reliability Cutoffs on Sample Characteristics and Effect Sizes: Performance‐Monitoring ERPs in Psychosis and Healthy Controls},
  journal = {Psychophysiology},
  year = {2025},
  doi = {10.1111/psyp.14758}
}
Infokarte | EUVIMED

Artikeldaten derzeit nicht verfügbar.

Recherche