Does performance invalidity undermine replication? Evidence from an undergraduate student participant sample
Archives of Clinical Neuropsychology · 29.05.2026 · 41 (5)
DOI: 10.1093/arclin/acag044 ↗Kurz gefasst
Fachartikel in der Zeitschrift Archives of Clinical Neuropsychology, online erschienen am 18.06.2026. Verfasst von Melanie A Mascarenhas und 1 weiteren Autor:innen. Beteiligte Einrichtung: Graduate Department of Psychological Clinical Science, University of Toronto Scarborough, Toronto, Ontario, Canada. Hauptthemen laut MEDLINE: Students, Neuropsychological Tests. Die Arbeit nennt 57 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: Social Sciences and Humanities Research.
Abstract (Originalsprache)
Objective
Performance invalidity is well-documented in clinical and forensic neuropsychology, yet its potential influence on data quality in psychological research has received little attention. This raises concerns for reproducibility, particularly given widespread use of undergraduate students as research participants. The present study examined whether incorporating Performance Validity Tests (PVTs) into a research protocol provides a practical method for improving data quality and interpretation.
Method
As part of a larger replication initiative, PVTs were embedded into a direct replication of a 2008 prescribed optimism study. 87 undergraduate students were classified as credible or non-credible based on PVT performance, and analyses were repeated within subgroups.
Results
The effect replicated successfully across the sample (d = 0.98), consistent with the original study (d = 0.93). 17.2% of participants failed one or more PVTs. The credible subgroup yielded a larger effect (d = 1.02) than the full sample, whereas the non-credible subgroup produced a smaller effect (d = 0.87), and a directional reversal in the secondary analysis – a pattern inconsistent with prior literature and suggestive of systematic noise that disengaged responding may introduce into data. Further, credible and non-credible subgroups differed significantly on the primary outcome despite being demographically and experimentally equivalent.
Conclusions
Performance invalidity occurs at a non-trivial rate in undergraduate research samples and can influence study outcomes. Incorporating PVTs into research protocols offers a practical, scalable safeguard to improving data quality and transparency, highlighting how neuropsychology’s established tools could contribute solutions to reproducibility challenges in psychological science.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Graduate Department of Psychological Clinical Science, University of Toronto Scarborough, Toronto, Ontario, Canada.
- Department of Psychology, University of Toronto Scarborough, Toronto, Ontario, Canada.
ORCID-Profile: Melanie A Mascarenhas
Förderung
- Social Sciences and Humanities Research
Zitieren
APA
Mascarenhas, M. A., & Zakzanis, K. K. (2026). Does performance invalidity undermine replication? Evidence from an undergraduate student participant sample. Archives of Clinical Neuropsychology, 41(5). https://doi.org/10.1093/arclin/acag044
Vancouver
Mascarenhas MA, Zakzanis KK. Does performance invalidity undermine replication? Evidence from an undergraduate student participant sample. Archives of Clinical Neuropsychology. 2026;41(5). doi:10.1093/arclin/acag044
BibTeX
@article{Mascarenhas2026,
author = {Mascarenhas, Melanie A and Zakzanis, Konstantine K},
title = {Does performance invalidity undermine replication? Evidence from an undergraduate student participant sample},
journal = {Archives of Clinical Neuropsychology},
year = {2026},
volume = {41},
number = {5},
doi = {10.1093/arclin/acag044}
}
EUVIMED