EUVIMEDEUVIMED entdecken
VergleichsstudieOpen Access · CC BY 4.0

Alternatives to default shrinkage methods can improve prediction accuracy, calibration, and coverage: A methods comparison study

Mark A van de Wiel iD, Gwenaël Gr Leday iD, Martijn W Heymans iD, Erik W van Zwet iD, Ailko H Zwinderman iD, Jeroen Hoogland iD

Statistical Methods in Medical Research · 2025

DOI: 10.1177/09622802251338440 ↗

Kurz gefasst

Vergleichsstudie in der Zeitschrift Statistical Methods in Medical Research, 2025. Verfasst von Mark A van de Wiel und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Epidemiology and Data Science, Amsterdam Public Health Research Institute, Amsterdam University Medical Centers, Amsterdam, the Netherl…. Hauptthemen laut MEDLINE: Calibration. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 29 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Seventh Framework Programme, Hartstichting, ZonMw.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

While shrinkage is essential in high-dimensional settings, its use for low-dimensional regression-based prediction has been debated. It reduces variance, often leading to improved prediction accuracy. However, it also inevitably introduces bias, which may harm two other measures of predictive performance: calibration and coverage of confidence intervals. Here, the latter evaluates whether the amount of uncertainty is correctly quantified. Much of the criticism stems from the usage of standard shrinkage methods, such as lasso and ridge with a single, cross-validated penalty. Our aim is to show that readily available alternatives may improve predictive performance, in terms of accuracy, calibration or coverage. We study linear and logistic regression. For linear regression, we use small sample splits of a large, fairly typical epidemiological data set to illustrate that usage of differential ridge penalties for covariate groups may enhance prediction accuracy, while calibration and coverage benefit from additional shrinkage of the penalties. Bayesian hierarchical modeling facilitates the latter, including local shrinkage. In the logistic regression setting, we apply an external simulation to illustrate that local shrinkage may improve calibration with respect to global shrinkage, while providing better prediction accuracy than other solutions, like Firth’s correction. The potential benefits of the alternative shrinkage methods are easily accessible via example implementations in R , including the estimation of multiple penalties. A synthetic copy of the large data set is shared for reproducibility.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

CalibrationBayes TheoremLinear ModelsLogistic ModelsModels, Statistical

Stichwörter der Autor:innen

Shrinkagecalibrationcoveragepredictionregression

Autor:innen und Institutionen

  • Department of Epidemiology and Data Science, Amsterdam Public Health Research Institute, Amsterdam University Medical Centers, Amsterdam, the Netherlands.
  • Biometris, Wageningen University and Research, Wageningen, the Netherlands.
  • Department of Biomedical Data Sciences, Leiden University Medical Center, Leiden, the Netherlands.

ORCID-Profile: Mark A van de Wiel, Gwenaël Gr Leday, Martijn W Heymans, Erik W van Zwet, Ailko H Zwinderman, Jeroen Hoogland

Förderung

  • Seventh Framework Programme
  • Hartstichting
  • ZonMw
  • European Integration Fund

Zitieren

APA

van de Wiel, M. A., Leday, G. G., Heymans, M. W., van Zwet, E. W., Zwinderman, A. H., & Hoogland, J. (2025). Alternatives to default shrinkage methods can improve prediction accuracy, calibration, and coverage: A methods comparison study. Statistical Methods in Medical Research. https://doi.org/10.1177/09622802251338440

Vancouver

van de Wiel MA, Leday GG, Heymans MW, van Zwet EW, Zwinderman AH, Hoogland J. Alternatives to default shrinkage methods can improve prediction accuracy, calibration, and coverage: A methods comparison study. Statistical Methods in Medical Research. 2025. doi:10.1177/09622802251338440

BibTeX
@article{vandeWiel2025,
  author = {van de Wiel, Mark A and Leday, Gwenaël Gr and Heymans, Martijn W and van Zwet, Erik W and Zwinderman, Ailko H and Hoogland, Jeroen},
  title = {Alternatives to default shrinkage methods can improve prediction accuracy, calibration, and coverage: A methods comparison study},
  journal = {Statistical Methods in Medical Research},
  year = {2025},
  doi = {10.1177/09622802251338440}
}
Kostenlos starten →