Repeated Sieving for Prediction Model Building with High-Dimensional Data
Journal of Personalized Medicine · 19.07.2024 · 14 (7) · 769
DOI: 10.3390/jpm14070769 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Personalized Medicine, online erschienen am 19.07.2024. Verfasst von Lu Liu und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Biostatistics and Bioinformatics, Duke University, Durham, NC 27708, USA. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 23 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Background
The prediction of patients’ outcomes is a key component in personalized medicine. Oftentimes, a prediction model is developed using a large number of candidate predictors, called high-dimensional data, including genomic data, lab tests, electronic health records, etc. Variable selection, also called dimension reduction, is a critical step in developing a prediction model using high-dimensional data.
Methods
In this paper, we compare the variable selection and prediction performance of popular machine learning (ML) methods with our proposed method. LASSO is a popular ML method that selects variables by imposing an L1-norm penalty to the likelihood. By this approach, LASSO selects features based on the size of regression estimates, rather than their statistical significance. As a result, LASSO can miss significant features while it is known to over-select features. Elastic net (EN), another popular ML method, tends to select even more features than LASSO since it uses a combination of L1- and L2-norm penalties that is less strict than an L1-norm penalty. Insignificant features included in a fitted prediction model act like white noises, so that the fitted model will lose prediction accuracy. Furthermore, for the future use of a fitted prediction model, we have to collect the data of all the features included in the model, which will cost a lot and possibly lower the accuracy of the data if the number of features is too many. Therefore, we propose an ML method, called repeated sieving, extending the standard regression methods with stepwise variable selection. By selecting features based on their statistical significance, it resolves the over-selection issue with high-dimensional data.
Results
Through extensive numerical studies and real data examples, our results show that the repeated sieving method selects far fewer features than LASSO and EN, but has higher prediction accuracy than the existing ML methods.
Conclusions
We conclude that our repeated sieving method performs well in both variable selection and prediction, and it saves the cost of future investigation on the selected factors.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Biostatistics and Bioinformatics, Duke University, Durham, NC 27708, USA.
ORCID-Profile: Sin-Ho Jung
Zitieren
APA
Liu, L., & Jung, S. H. (2024). Repeated Sieving for Prediction Model Building with High-Dimensional Data. Journal of Personalized Medicine, 14(7), 769. https://doi.org/10.3390/jpm14070769
Vancouver
Liu L, Jung SH. Repeated Sieving for Prediction Model Building with High-Dimensional Data. Journal of Personalized Medicine. 2024;14(7):769. doi:10.3390/jpm14070769
BibTeX
@article{Liu2024,
author = {Liu, Lu and Jung, Sin-Ho},
title = {Repeated Sieving for Prediction Model Building with High-Dimensional Data},
journal = {Journal of Personalized Medicine},
year = {2024},
volume = {14},
number = {7},
pages = {769},
doi = {10.3390/jpm14070769}
}
EUVIMED