EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

When to Adjust for Multiple Testing: A Unifying Guiding Principle

Sabine Hoffmann iD, Simon Lemster, Gary Collins, Alexander Hapfelmeier, Georg Heinze, Andreas Mayr iD, Matthias Schmid iD, Juliane C Wilcke, Anne-Laure Boulesteix iD

Biometrical Journal · 2026-08 · 68 (4)

DOI: 10.1002/bimj.70148 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Biometrical Journal, online erschienen am 02.07.2026. Verfasst von Sabine Hoffmann und 8 weiteren Autor:innen. Beteiligte Einrichtung: Department of Statistics, LMU Munich, Munich, Germany. Hauptthemen laut MEDLINE: Biometry. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 42 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: German Research Foundation, Deutsche Forschungsgemeinschaft.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Most original articles published in the medical literature report the results of multiple statistical tests. In a few simple cases, there is agreement on whether to adjust for the number of performed tests. For many cases encountered in practice, however, this is less clear, and the recommendations in the literature are contradictory, along different dimensions, or otherwise confusing. This lack of clear guidance may impair the conduct and interpretation of analyses, and encourage questionable research practices, ultimately jeopardizing the credibility of medical research. In this article, we refine, illustrate, and discuss a unifying guiding principle to assist both statisticians and applied researchers in deciding whether to adjust for multiple testing and, if so, over which set of tests. The principle is that multiple testing should be adjusted for if and only if authors, when reporting and interpreting their findings, put more emphasis on results of one or several of the tests because of their small p‐value(s) . We relate this principle to previously proposed rules and show how it can guide and clarify the choice of adjustment strategies in three complex multiple testing settings.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

BiometryData Interpretation, StatisticalHumans

Stichwörter der Autor:innen

Type I errorfamily‐wise error rategood practiceguidancehypothesis testingmultiplicityreporting

Autor:innen und Institutionen

  • Department of Statistics, LMU Munich, Munich, Germany.
  • Institute for Medical Information Processing, Biometry, and Epidemiology, LMU Medizin, LMU Munich, Munich, Germany.
  • Department of Applied Health Sciences, School of Health Sciences, College of Medicine and Health, University of Birmingham, Birmingham, UK.
  • Institute of AI and Informatics in Medicine, TUM School of Medicine and Health, Technical University of Munich, Munich, Germany.
  • Institute of General Practice and Health Services Research, TUM School of Medicine and Health, Technical University of Munich, Munich, Germany.
  • Institute of Clinical Biometrics, Center for Medical Data Science, Medical University of Vienna, Vienna, Austria.

ORCID-Profile: Sabine Hoffmann, Andreas Mayr, Matthias Schmid, Anne-Laure Boulesteix

Förderung

  • German Research Foundation
  • Deutsche Forschungsgemeinschaft

Zitieren

APA

Hoffmann, S., Lemster, S., Collins, G., Hapfelmeier, A., Heinze, G., Mayr, A., Schmid, M., Wilcke, J. C., & Boulesteix, A. L. (2026). When to Adjust for Multiple Testing: A Unifying Guiding Principle. Biometrical Journal, 68(4). https://doi.org/10.1002/bimj.70148

Vancouver

Hoffmann S, Lemster S, Collins G, Hapfelmeier A, Heinze G, Mayr A, et al. When to Adjust for Multiple Testing: A Unifying Guiding Principle. Biometrical Journal. 2026;68(4). doi:10.1002/bimj.70148

BibTeX
@article{Hoffmann2026,
  author = {Hoffmann, Sabine and Lemster, Simon and Collins, Gary and Hapfelmeier, Alexander and Heinze, Georg and Mayr, Andreas and Schmid, Matthias and Wilcke, Juliane C and Boulesteix, Anne-Laure},
  title = {When to Adjust for Multiple Testing: A Unifying Guiding Principle},
  journal = {Biometrical Journal},
  year = {2026},
  volume = {68},
  number = {4},
  doi = {10.1002/bimj.70148}
}
Kostenlos starten →