EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Does performance invalidity undermine replication? Evidence from an undergraduate student participant sample

Melanie A Mascarenhas iD, Konstantine K Zakzanis

Archives of Clinical Neuropsychology · 29.05.2026 · 41 (5)

DOI: 10.1093/arclin/acag044 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Archives of Clinical Neuropsychology, online erschienen am 18.06.2026. Verfasst von Melanie A Mascarenhas und 1 weiteren Autor:innen. Beteiligte Einrichtung: Graduate Department of Psychological Clinical Science, University of Toronto Scarborough, Toronto, Ontario, Canada. Hauptthemen laut MEDLINE: Students, Neuropsychological Tests. Die Arbeit nennt 57 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: Social Sciences and Humanities Research.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Objective

Performance invalidity is well-documented in clinical and forensic neuropsychology, yet its potential influence on data quality in psychological research has received little attention. This raises concerns for reproducibility, particularly given widespread use of undergraduate students as research participants. The present study examined whether incorporating Performance Validity Tests (PVTs) into a research protocol provides a practical method for improving data quality and interpretation.

Method

As part of a larger replication initiative, PVTs were embedded into a direct replication of a 2008 prescribed optimism study. 87 undergraduate students were classified as credible or non-credible based on PVT performance, and analyses were repeated within subgroups.

Results

The effect replicated successfully across the sample (d = 0.98), consistent with the original study (d = 0.93). 17.2% of participants failed one or more PVTs. The credible subgroup yielded a larger effect (d = 1.02) than the full sample, whereas the non-credible subgroup produced a smaller effect (d = 0.87), and a directional reversal in the secondary analysis – a pattern inconsistent with prior literature and suggestive of systematic noise that disengaged responding may introduce into data. Further, credible and non-credible subgroups differed significantly on the primary outcome despite being demographically and experimentally equivalent.

Conclusions

Performance invalidity occurs at a non-trivial rate in undergraduate research samples and can influence study outcomes. Incorporating PVTs into research protocols offers a practical, scalable safeguard to improving data quality and transparency, highlighting how neuropsychology’s established tools could contribute solutions to reproducibility challenges in psychological science.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

StudentsNeuropsychological TestsHumansReproducibility of ResultsMaleFemaleYoung AdultUniversitiesAdult

Stichwörter der Autor:innen

performance invalidityperformance validity testsreplicationreplication crisisundergraduate research participants

Autor:innen und Institutionen

  • Graduate Department of Psychological Clinical Science, University of Toronto Scarborough, Toronto, Ontario, Canada.
  • Department of Psychology, University of Toronto Scarborough, Toronto, Ontario, Canada.

ORCID-Profile: Melanie A Mascarenhas

Förderung

  • Social Sciences and Humanities Research

Zitieren

APA

Mascarenhas, M. A., & Zakzanis, K. K. (2026). Does performance invalidity undermine replication? Evidence from an undergraduate student participant sample. Archives of Clinical Neuropsychology, 41(5). https://doi.org/10.1093/arclin/acag044

Vancouver

Mascarenhas MA, Zakzanis KK. Does performance invalidity undermine replication? Evidence from an undergraduate student participant sample. Archives of Clinical Neuropsychology. 2026;41(5). doi:10.1093/arclin/acag044

BibTeX
@article{Mascarenhas2026,
  author = {Mascarenhas, Melanie A and Zakzanis, Konstantine K},
  title = {Does performance invalidity undermine replication? Evidence from an undergraduate student participant sample},
  journal = {Archives of Clinical Neuropsychology},
  year = {2026},
  volume = {41},
  number = {5},
  doi = {10.1093/arclin/acag044}
}
Kostenlos starten →