The Problem of Redundant Variables in Random Forests
Acta Universitatis Lodziensis. Folia Oeconomica · 13.02.2019 · 6 (339) · 7-16
DOI: 10.18778/0208-6018.339.01 ↗Kurz gefasst
Fachartikel in der Zeitschrift Acta Universitatis Lodziensis. Folia Oeconomica, online erschienen am 13.02.2019. Verfasst von Mariusz Kubus. Die Arbeit wurde bisher 16-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY 3.0).
Abstract (Originalsprache)
Random forests are currently one of the most preferable methods of supervised learning among practitioners. Their popularity is influenced by the possibility of applying this method without a time consuming pre‑processing step. Random forests can be used for mixed types of features, irrespectively of their distributions. The method is robust to outliers, and feature selection is built into the learning algorithm. However, a decrease of classification accuracy can be observed in the presence of redundant variables. In this paper, we discuss two approaches to the problem of redundant variables. We consider two strategies of searching for best feature subset as well as two formulas of aggregating the features in the clusters. In the empirical experiment, we generate collinear predictors and include them in the real datasets. Dimensionality reduction methods usually improve the accuracy of random forests, but none of them clearly outperforms the others.
Zitieren
APA
Kubus, M. (2019). The Problem of Redundant Variables in Random Forests. Acta Universitatis Lodziensis. Folia Oeconomica, 6(339), 7-16. https://doi.org/10.18778/0208-6018.339.01
Vancouver
Kubus M. The Problem of Redundant Variables in Random Forests. Acta Universitatis Lodziensis. Folia Oeconomica. 2019;6(339):7-16. doi:10.18778/0208-6018.339.01
BibTeX
@article{Kubus2019,
author = {Kubus, Mariusz},
title = {The Problem of Redundant Variables in Random Forests},
journal = {Acta Universitatis Lodziensis. Folia Oeconomica},
year = {2019},
volume = {6},
number = {339},
pages = {7--16},
doi = {10.18778/0208-6018.339.01}
}
EUVIMED