A comparison of random forest variable selection methods for regression modeling of continuous outcomes
Briefings in Bioinformatics · 04.03.2025 · 26 (2)
DOI: 10.1093/bib/bbaf096 ↗Kurz gefasst
Vergleichsstudie in der Zeitschrift Briefings in Bioinformatics, online erschienen am 10.03.2025. Verfasst von Nathaniel S O'Connell und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Biostatistics and Data Science, Wake Forest University School of Medicine, Medical Center Boulevard, Winston-Salem, NC 27157, United St…. Hauptthemen laut MEDLINE: Machine Learning, Computational Biology. Die Arbeit wurde bisher 26-mal zitiert (Crossref) und nennt 32 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NIA NIH HHS.
Abstract (Originalsprache)
Random forest (RF) regression is popular machine learning method to develop prediction models for continuous outcomes. Variable selection, also known as feature selection or reduction, involves selecting a subset of predictor variables for modeling. Potential benefits of variable selection are methodologic (i.e. improving prediction accuracy and computational efficiency) and practical (i.e. reducing the burden of data collection and improving efficiency). Several variable selection methods leveraging RFs have been proposed, but there is limited evidence to guide decisions on which methods may be preferable for different types of datasets with continuous outcomes. Using 59 publicly available datasets in a benchmarking study, we evaluated the implementation of 13 RF variable selection methods. Performance of variable selection was measured via out-of-sample R2 of a RF that used the variables selected for each method. Simplicity of variable selection was measured via the percent reduction in the number of variables selected out of the number of variables available. Efficiency was measured via computational time required to complete the variable selection. Based on our benchmarking study, variable selection methods implemented in the Boruta and aorsf R packages selected the best subset of variables for axis-based RF models, whereas methods implemented in the aorsf R package selected the best subset of variables for oblique RF models. A significant contribution of this study is the ability to assess different variable selection methods in the setting of RF regression for continuous outcomes to identify preferable methods using an open science approach.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Biostatistics and Data Science, Wake Forest University School of Medicine, Medical Center Boulevard, Winston-Salem, NC 27157, United States.
- Department of Orthopedic Surgery, Wake Forest University School of Medicine, Medical Center Boulevard, Winston-Salem, NC 27157, United States.
ORCID-Profile: Jaime Lynn Speiser
Förderung
- NIA NIH HHS
Zitieren
APA
O'Connell, N. S., Jaeger, B. C., Bullock, G. S., & Speiser, J. L. (2025). A comparison of random forest variable selection methods for regression modeling of continuous outcomes. Briefings in Bioinformatics, 26(2). https://doi.org/10.1093/bib/bbaf096
Vancouver
O'Connell NS, Jaeger BC, Bullock GS, Speiser JL. A comparison of random forest variable selection methods for regression modeling of continuous outcomes. Briefings in Bioinformatics. 2025;26(2). doi:10.1093/bib/bbaf096
BibTeX
@article{OConnell2025,
author = {O'Connell, Nathaniel S and Jaeger, Byron C and Bullock, Garrett S and Speiser, Jaime Lynn},
title = {A comparison of random forest variable selection methods for regression modeling of continuous outcomes},
journal = {Briefings in Bioinformatics},
year = {2025},
volume = {26},
number = {2},
doi = {10.1093/bib/bbaf096}
}
EUVIMED