Two-stage subsampling variable selection for sparse high-dimensional generalized linear models
Statistical Methods in Medical Research · 2025
DOI: 10.1177/09622802251343597 ↗Kurz gefasst
Fachartikel in der Zeitschrift Statistical Methods in Medical Research, 2025. Verfasst von Marinela Capanu und 3 weiteren Autor:innen. Beteiligte Einrichtung: Memorial Sloan Kettering Cancer Center, NYC, NY, USA. Hauptthemen laut MEDLINE: Linear Models. Die Arbeit nennt 54 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: NCI NIH HHS, Center for Cancer Research.
Abstract (Originalsprache)
Although high-dimensional data analysis has received a lot of attention after the advent of omics data, model selection in this setting continues to be challenging and there is still substantial room for improvement. Through a novel combination of existing methods, we propose here a two-stage subsampling approach for variable selection in high-dimensional generalized linear regression models. In the first stage, we screen the variables using smoothly clipped absolute deviance penalty regularization followed by partial least squares regression on repeated subsamples of the data; we include in the second stage only those predictors that were most frequently selected over the subsamples either by smoothly clipped absolute deviance or for having the top loadings in either of the first two partial least squares regression components. In the second stage, we again repeatedly subsample the data and, for each subsample, we find the best Akaike information criterion model based on an exhaustive search of all possible models on the reduced set of predictors. We then include in the final model those predictors with high selection probability across the subsamples. We prove that the proposed first-stage estimator is n 1 / 2 -consistent and that the true predictors are included in the first stage with probability converging to 1. In an extensive simulation study, we show that this two-stage approach outperforms the competitors yielding among the highest probability of selecting the true model while having one of the lowest number of false positives in the settings of logistic, Poisson, and linear regression. We illustrate the proposed method on two gene expression cancer datasets.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Memorial Sloan Kettering Cancer Center, NYC, NY, USA.
- Department of Public Health Sciences, University of Chicago, Chicago, IL, USA.
ORCID-Profile: Marinela Capanu
Förderung
- NCI NIH HHS
- Center for Cancer Research
Zitieren
APA
Capanu, M., Giurcanu, M., Begg, C. B., & Gönen, M. (2025). Two-stage subsampling variable selection for sparse high-dimensional generalized linear models. Statistical Methods in Medical Research. https://doi.org/10.1177/09622802251343597
Vancouver
Capanu M, Giurcanu M, Begg CB, Gönen M. Two-stage subsampling variable selection for sparse high-dimensional generalized linear models. Statistical Methods in Medical Research. 2025. doi:10.1177/09622802251343597
BibTeX
@article{Capanu2025,
author = {Capanu, Marinela and Giurcanu, Mihai and Begg, Colin B and Gönen, Mithat},
title = {Two-stage subsampling variable selection for sparse high-dimensional generalized linear models},
journal = {Statistical Methods in Medical Research},
year = {2025},
doi = {10.1177/09622802251343597}
}
EUVIMED