EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Addressing threats to validity in large dataset research

Wonsuk Yoo iD, John P A Ioannidis iD

PLOS Medicine · 02.11.2026 · 23 (11) · e1005282

DOI: 10.1371/journal.pmed.1005282 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS Medicine, online erschienen am 02.11.2026. Verfasst von Wonsuk Yoo und 1 weiteren Autor:innen. Beteiligte Einrichtung: School of Nursing and Health Studies, Division of Biostatistics/Bioinformatics, Department of Public Health Sciences, TCO Program, Sylvester Comprehe…. Hauptthemen laut MEDLINE: Datasets as Topic, Biomedical Research, Research Design. Die Arbeit nennt 80 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

points Large dataset research offers new opportunities across biomedicine, but it also faces major threats to validity. These threats are underappreciated and often not recognized or managed appropriately. We dissect here 4 major types of validity threats: (1) P -value inflation and trivial effects; (2) residual and differential confounding across multiple sites; (3) issues surrounding harmonization and measurement error; and (4) causal identification in the presence of rich covariates. For each of them we provide their theoretical background, empirical evidence, and simulations that showcase how they operate. We make recommendations that may offer guidance for analyses and inferences from large datasets across biomedicine. These include: deciding on the placement in a continuum of exploration versus targeted causation; evaluating both statistical significance and effect sizes; modeling site heterogeneity; treating harmonization as measurement modeling; considering causal diagrams to guide adjustment; checking covariate balance; embedding sensitivity analysis and exploration of robustness; reporting limitations structurally; considering falsification calibration of performance; considering multi-analyst approaches; enhancing sharing, openness, transparency, and documentation; and considering encompassing analyses rather than least publishable units. Improving large dataset research and adequately addressing these threats is essential for the integrity of the scientific record and eventually also for informing policy and clinical practice.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Datasets as TopicBiomedical ResearchResearch DesignHumansReproducibility of Results

Autor:innen und Institutionen

  • School of Nursing and Health Studies, Division of Biostatistics/Bioinformatics, Department of Public Health Sciences, TCO Program, Sylvester Comprehensive Cancer Center, University of Miami, Coral Gables, Florida, Unite…
  • Meta-Research Innovation Center at Stanford (METRICS), Stanford University, California, United States of America.
  • Stanford Prevention Research Center, Department of Medicine, Stanford University School of Medicine, Stanford, California, United States of America.
  • Department of Epidemiology and Population Health, Stanford University School of Medicine, Stanford, California, United States of America.
  • SDepartment of Biomedical Data Science, Stanford University School of Medicine, Stanford, California, United States of America.

ORCID-Profile: Wonsuk Yoo, John P A Ioannidis

Zitieren

APA

Yoo, W., & Ioannidis, J. P. A. (2026). Addressing threats to validity in large dataset research. PLOS Medicine, 23(11), e1005282. https://doi.org/10.1371/journal.pmed.1005282

Vancouver

Yoo W, Ioannidis JPA. Addressing threats to validity in large dataset research. PLOS Medicine. 2026;23(11):e1005282. doi:10.1371/journal.pmed.1005282

BibTeX
@article{Yoo2026,
  author = {Yoo, Wonsuk and Ioannidis, John P A},
  title = {Addressing threats to validity in large dataset research},
  journal = {PLOS Medicine},
  year = {2026},
  volume = {23},
  number = {11},
  pages = {e1005282},
  doi = {10.1371/journal.pmed.1005282}
}
Kostenlos starten →