Addressing threats to validity in large dataset research
PLOS Medicine · 02.11.2026 · 23 (11) · e1005282
DOI: 10.1371/journal.pmed.1005282 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS Medicine, online erschienen am 02.11.2026. Verfasst von Wonsuk Yoo und 1 weiteren Autor:innen. Beteiligte Einrichtung: School of Nursing and Health Studies, Division of Biostatistics/Bioinformatics, Department of Public Health Sciences, TCO Program, Sylvester Comprehe…. Hauptthemen laut MEDLINE: Datasets as Topic, Biomedical Research, Research Design. Die Arbeit nennt 80 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
points Large dataset research offers new opportunities across biomedicine, but it also faces major threats to validity. These threats are underappreciated and often not recognized or managed appropriately. We dissect here 4 major types of validity threats: (1) P -value inflation and trivial effects; (2) residual and differential confounding across multiple sites; (3) issues surrounding harmonization and measurement error; and (4) causal identification in the presence of rich covariates. For each of them we provide their theoretical background, empirical evidence, and simulations that showcase how they operate. We make recommendations that may offer guidance for analyses and inferences from large datasets across biomedicine. These include: deciding on the placement in a continuum of exploration versus targeted causation; evaluating both statistical significance and effect sizes; modeling site heterogeneity; treating harmonization as measurement modeling; considering causal diagrams to guide adjustment; checking covariate balance; embedding sensitivity analysis and exploration of robustness; reporting limitations structurally; considering falsification calibration of performance; considering multi-analyst approaches; enhancing sharing, openness, transparency, and documentation; and considering encompassing analyses rather than least publishable units. Improving large dataset research and adequately addressing these threats is essential for the integrity of the scientific record and eventually also for informing policy and clinical practice.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- School of Nursing and Health Studies, Division of Biostatistics/Bioinformatics, Department of Public Health Sciences, TCO Program, Sylvester Comprehensive Cancer Center, University of Miami, Coral Gables, Florida, Unite…
- Meta-Research Innovation Center at Stanford (METRICS), Stanford University, California, United States of America.
- Stanford Prevention Research Center, Department of Medicine, Stanford University School of Medicine, Stanford, California, United States of America.
- Department of Epidemiology and Population Health, Stanford University School of Medicine, Stanford, California, United States of America.
- SDepartment of Biomedical Data Science, Stanford University School of Medicine, Stanford, California, United States of America.
ORCID-Profile: Wonsuk Yoo, John P A Ioannidis
Zitieren
APA
Yoo, W., & Ioannidis, J. P. A. (2026). Addressing threats to validity in large dataset research. PLOS Medicine, 23(11), e1005282. https://doi.org/10.1371/journal.pmed.1005282
Vancouver
Yoo W, Ioannidis JPA. Addressing threats to validity in large dataset research. PLOS Medicine. 2026;23(11):e1005282. doi:10.1371/journal.pmed.1005282
BibTeX
@article{Yoo2026,
author = {Yoo, Wonsuk and Ioannidis, John P A},
title = {Addressing threats to validity in large dataset research},
journal = {PLOS Medicine},
year = {2026},
volume = {23},
number = {11},
pages = {e1005282},
doi = {10.1371/journal.pmed.1005282}
}
EUVIMED