When to Adjust for Multiple Testing: A Unifying Guiding Principle
Biometrical Journal · 2026-08 · 68 (4)
DOI: 10.1002/bimj.70148 ↗Kurz gefasst
Fachartikel in der Zeitschrift Biometrical Journal, online erschienen am 02.07.2026. Verfasst von Sabine Hoffmann und 8 weiteren Autor:innen. Beteiligte Einrichtung: Department of Statistics, LMU Munich, Munich, Germany. Hauptthemen laut MEDLINE: Biometry. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 42 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: German Research Foundation, Deutsche Forschungsgemeinschaft.
Abstract (Originalsprache)
Most original articles published in the medical literature report the results of multiple statistical tests. In a few simple cases, there is agreement on whether to adjust for the number of performed tests. For many cases encountered in practice, however, this is less clear, and the recommendations in the literature are contradictory, along different dimensions, or otherwise confusing. This lack of clear guidance may impair the conduct and interpretation of analyses, and encourage questionable research practices, ultimately jeopardizing the credibility of medical research. In this article, we refine, illustrate, and discuss a unifying guiding principle to assist both statisticians and applied researchers in deciding whether to adjust for multiple testing and, if so, over which set of tests. The principle is that multiple testing should be adjusted for if and only if authors, when reporting and interpreting their findings, put more emphasis on results of one or several of the tests because of their small p‐value(s) . We relate this principle to previously proposed rules and show how it can guide and clarify the choice of adjustment strategies in three complex multiple testing settings.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Statistics, LMU Munich, Munich, Germany.
- Institute for Medical Information Processing, Biometry, and Epidemiology, LMU Medizin, LMU Munich, Munich, Germany.
- Department of Applied Health Sciences, School of Health Sciences, College of Medicine and Health, University of Birmingham, Birmingham, UK.
- Institute of AI and Informatics in Medicine, TUM School of Medicine and Health, Technical University of Munich, Munich, Germany.
- Institute of General Practice and Health Services Research, TUM School of Medicine and Health, Technical University of Munich, Munich, Germany.
- Institute of Clinical Biometrics, Center for Medical Data Science, Medical University of Vienna, Vienna, Austria.
ORCID-Profile: Sabine Hoffmann, Andreas Mayr, Matthias Schmid, Anne-Laure Boulesteix
Förderung
- German Research Foundation
- Deutsche Forschungsgemeinschaft
Zitieren
APA
Hoffmann, S., Lemster, S., Collins, G., Hapfelmeier, A., Heinze, G., Mayr, A., Schmid, M., Wilcke, J. C., & Boulesteix, A. L. (2026). When to Adjust for Multiple Testing: A Unifying Guiding Principle. Biometrical Journal, 68(4). https://doi.org/10.1002/bimj.70148
Vancouver
Hoffmann S, Lemster S, Collins G, Hapfelmeier A, Heinze G, Mayr A, et al. When to Adjust for Multiple Testing: A Unifying Guiding Principle. Biometrical Journal. 2026;68(4). doi:10.1002/bimj.70148
BibTeX
@article{Hoffmann2026,
author = {Hoffmann, Sabine and Lemster, Simon and Collins, Gary and Hapfelmeier, Alexander and Heinze, Georg and Mayr, Andreas and Schmid, Matthias and Wilcke, Juliane C and Boulesteix, Anne-Laure},
title = {When to Adjust for Multiple Testing: A Unifying Guiding Principle},
journal = {Biometrical Journal},
year = {2026},
volume = {68},
number = {4},
doi = {10.1002/bimj.70148}
}
EUVIMED