Effects of stopping criterion on the growth of trees in regression random forests
The New England Journal of Statistics in Data Science · 2023
DOI: 10.51387/22-nejsds5 ↗Kurz gefasst
Fachartikel in der Zeitschrift The New England Journal of Statistics in Data Science, 2023. Verfasst von Aryana Arsham und 2 weiteren Autor:innen. Beteiligte Einrichtung: Center for Data, Mathematical & Computational Sciences, Integrative Data Analytics, Goucher College, USA. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 19 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Intramural NIH HHS.
Abstract (Originalsprache)
Random forests are a powerful machine learning tool that capture complex relationships between independent variables and an outcome of interest. Trees built in a random forest are dependent on several hyperparameters, one of the more critical being the node size. The original algorithm of Breiman, controls for node size by limiting the size of the parent node, so that a node cannot be split if it has less than a specified number of observations. We propose that this hyperparameter should instead be defined as the minimum number of observations in each terminal node. The two existing random forest approaches are compared in the regression context based on estimated generalization error, bias-squared, and variance of resulting predictions in a number of simulated datasets. Additionally the two approaches are applied to type 2 diabetes data obtained from the National Health and Nutrition Examination Survey. We have developed a straightforward method for incorporating weights into the random forest analysis of survey data. Our results demonstrate that generalization error under the proposed approach is competitive to that attained from the original random forest approach when data have large random error variability. The R code created from this work is available and includes an illustration.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Center for Data, Mathematical & Computational Sciences, Integrative Data Analytics, Goucher College, USA.
- Biostatistics Branch, National Cancer Institute, USA.
- Radiation Epidemiology Branch, National Cancer Institute, USA.
Förderung
- Intramural NIH HHS
Zitieren
APA
Arsham, A., Rosenberg, P., & Little, M. (2023). Effects of stopping criterion on the growth of trees in regression random forests. The New England Journal of Statistics in Data Science. https://doi.org/10.51387/22-nejsds5
Vancouver
Arsham A, Rosenberg P, Little M. Effects of stopping criterion on the growth of trees in regression random forests. The New England Journal of Statistics in Data Science. 2023. doi:10.51387/22-nejsds5
BibTeX
@article{Arsham2023,
author = {Arsham, Aryana and Rosenberg, Philip and Little, Mark},
title = {Effects of stopping criterion on the growth of trees in regression random forests},
journal = {The New England Journal of Statistics in Data Science},
year = {2023},
doi = {10.51387/22-nejsds5}
}
EUVIMED