Overfitting in Machine Learning: A Comparative Analysis of Decision Trees and Random Forests
Intelligent Automation & Soft Computing · 2024 · 39 (6) · 987-1006
DOI: 10.32604/iasc.2024.059429 ↗Kurz gefasst
Fachartikel in der Zeitschrift Intelligent Automation & Soft Computing, 2024. Verfasst von Erblin Halabaku und 1 weiteren Autor:innen. Die Arbeit wurde bisher 108-mal zitiert (Crossref) und nennt 30 Literaturangaben.
Abstract (Originalsprache)
Machine learning has emerged as a pivotal tool in deciphering and managing this excess of information in an era of abundant data. This paper presents a comprehensive analysis of machine learning algorithms, focusing on the structure and efficacy of random forests in mitigating overfitting — a prevalent issue in decision tree models. It also introduces a novel approach to enhancing decision tree performance through an optimized pruning method called Adaptive Cross-Validated Alpha CCP (ACV-CCP). This method refines traditional cost complexity pruning by streamlining the selection of the alpha parameter, leveraging cross-validation within the pruning process to achieve a reliable, computationally efficient alpha selection that generalizes well to unseen data. By enhancing computational efficiency and balancing model complexity, ACV-CCP allows decision trees to maintain predictive accuracy while minimizing overfitting, effectively narrowing the performance gap between decision trees and random forests. Our findings illustrate how ACV-CCP contributes to the robustness and applicability of decision trees, providing a valuable perspective on achieving computationally efficient and generalized machine learning models.
Zitieren
APA
Halabaku, E., & Bytyçi, E. (2024). Overfitting in Machine Learning: A Comparative Analysis of Decision Trees and Random Forests. Intelligent Automation & Soft Computing, 39(6), 987-1006. https://doi.org/10.32604/iasc.2024.059429
Vancouver
Halabaku E, Bytyçi E. Overfitting in Machine Learning: A Comparative Analysis of Decision Trees and Random Forests. Intelligent Automation & Soft Computing. 2024;39(6):987-1006. doi:10.32604/iasc.2024.059429
BibTeX
@article{Halabaku2024,
author = {Halabaku, Erblin and Bytyçi, Eliot},
title = {Overfitting in Machine Learning: A Comparative Analysis of Decision Trees and Random Forests},
journal = {Intelligent Automation & Soft Computing},
year = {2024},
volume = {39},
number = {6},
pages = {987--1006},
doi = {10.32604/iasc.2024.059429}
}
EUVIMED