Alternatives to default shrinkage methods can improve prediction accuracy, calibration, and coverage: A methods comparison study
Statistical Methods in Medical Research · 2025
DOI: 10.1177/09622802251338440 ↗Kurz gefasst
Vergleichsstudie in der Zeitschrift Statistical Methods in Medical Research, 2025. Verfasst von Mark A van de Wiel und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Epidemiology and Data Science, Amsterdam Public Health Research Institute, Amsterdam University Medical Centers, Amsterdam, the Netherl…. Hauptthemen laut MEDLINE: Calibration. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 29 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Seventh Framework Programme, Hartstichting, ZonMw.
Abstract (Originalsprache)
While shrinkage is essential in high-dimensional settings, its use for low-dimensional regression-based prediction has been debated. It reduces variance, often leading to improved prediction accuracy. However, it also inevitably introduces bias, which may harm two other measures of predictive performance: calibration and coverage of confidence intervals. Here, the latter evaluates whether the amount of uncertainty is correctly quantified. Much of the criticism stems from the usage of standard shrinkage methods, such as lasso and ridge with a single, cross-validated penalty. Our aim is to show that readily available alternatives may improve predictive performance, in terms of accuracy, calibration or coverage. We study linear and logistic regression. For linear regression, we use small sample splits of a large, fairly typical epidemiological data set to illustrate that usage of differential ridge penalties for covariate groups may enhance prediction accuracy, while calibration and coverage benefit from additional shrinkage of the penalties. Bayesian hierarchical modeling facilitates the latter, including local shrinkage. In the logistic regression setting, we apply an external simulation to illustrate that local shrinkage may improve calibration with respect to global shrinkage, while providing better prediction accuracy than other solutions, like Firth’s correction. The potential benefits of the alternative shrinkage methods are easily accessible via example implementations in R , including the estimation of multiple penalties. A synthetic copy of the large data set is shared for reproducibility.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Epidemiology and Data Science, Amsterdam Public Health Research Institute, Amsterdam University Medical Centers, Amsterdam, the Netherlands.
- Biometris, Wageningen University and Research, Wageningen, the Netherlands.
- Department of Biomedical Data Sciences, Leiden University Medical Center, Leiden, the Netherlands.
ORCID-Profile: Mark A van de Wiel, Gwenaël Gr Leday, Martijn W Heymans, Erik W van Zwet, Ailko H Zwinderman, Jeroen Hoogland
Förderung
- Seventh Framework Programme
- Hartstichting
- ZonMw
- European Integration Fund
Zitieren
APA
van de Wiel, M. A., Leday, G. G., Heymans, M. W., van Zwet, E. W., Zwinderman, A. H., & Hoogland, J. (2025). Alternatives to default shrinkage methods can improve prediction accuracy, calibration, and coverage: A methods comparison study. Statistical Methods in Medical Research. https://doi.org/10.1177/09622802251338440
Vancouver
van de Wiel MA, Leday GG, Heymans MW, van Zwet EW, Zwinderman AH, Hoogland J. Alternatives to default shrinkage methods can improve prediction accuracy, calibration, and coverage: A methods comparison study. Statistical Methods in Medical Research. 2025. doi:10.1177/09622802251338440
BibTeX
@article{vandeWiel2025,
author = {van de Wiel, Mark A and Leday, Gwenaël Gr and Heymans, Martijn W and van Zwet, Erik W and Zwinderman, Ailko H and Hoogland, Jeroen},
title = {Alternatives to default shrinkage methods can improve prediction accuracy, calibration, and coverage: A methods comparison study},
journal = {Statistical Methods in Medical Research},
year = {2025},
doi = {10.1177/09622802251338440}
}
EUVIMED