A Tutorial on Supervised Machine Learning Variable Selection Methods in Classification for the Social and Health Sciences in R
Journal of Behavioral Data Science · 2025
DOI: 10.35566/jbds/bain ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Behavioral Data Science, 2025. Verfasst von Catherine Bain und 5 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref).
Abstract (Originalsprache)
With the increasing availability of large datasets in the behavioral and health sciences, the need for efficient and effective variable selection techniques has grown. While traditional methods like stepwise regression remain prevalent, numerous advanced techniques are available but underutilized in these fields. This tutorial aims to increase awareness and understanding of five variable selection methods available in the popular statistical software R: LASSO, Elastic Net, a penalized SVM classifier, random forest, and the genetic algorithm. Using a recent survey-based assessment dataset on misophonia diagnosis, we provide step-by-step guidance on variables selections and implementation of each method in the context of classification. We discuss the strengths, weaknesses, and performance of each technique, emphasizing the importance of selecting appropriate performance metrics. The associated code and data implemented in this tutorial are available on Open Science Framework and provide an interactive learning experience. We encourage social and health science researchers to adopt these advanced variable selection methods, leading to more robust, interpretable, and impactful models. This paper is written with the assumption that individuals have at least a basic understanding of R.
Zitieren
APA
Bain, C., Shi, D., Banad, Y., Ethridge, L., Norris, J., & Loeffelman, J. (2025). A Tutorial on Supervised Machine Learning Variable Selection Methods in Classification for the Social and Health Sciences in R. Journal of Behavioral Data Science. https://doi.org/10.35566/jbds/bain
Vancouver
Bain C, Shi D, Banad Y, Ethridge L, Norris J, Loeffelman J. A Tutorial on Supervised Machine Learning Variable Selection Methods in Classification for the Social and Health Sciences in R. Journal of Behavioral Data Science. 2025. doi:10.35566/jbds/bain
BibTeX
@article{Bain2025,
author = {Bain, Catherine and Shi, Dingjing and Banad, Yaser and Ethridge, Lauren and Norris, Jordan and Loeffelman, Jordan},
title = {A Tutorial on Supervised Machine Learning Variable Selection Methods in Classification for the Social and Health Sciences in R},
journal = {Journal of Behavioral Data Science},
year = {2025},
doi = {10.35566/jbds/bain}
}
EUVIMED