Comparative Evaluation and Comprehensive Analysis of Machine Learning Models for Regression Problems
Data Intelligence · 01.07.2022 · 4 (3) · 620-652
DOI: 10.1162/dint_a_00155 ↗Kurz gefasst
Fachartikel in der Zeitschrift Data Intelligence, online erschienen am 01.07.2022. Verfasst von Boran Sekeroglu und 3 weiteren Autor:innen. Die Arbeit wurde bisher 89-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Artificial intelligence and machine learning applications are of significant importance almost in every field of human life to solve problems or support human experts. However, the determination of the machine learning model to achieve a superior result for a particular problem within the wide real-life application areas is still a challenging task for researchers. The success of a model could be affected by several factors such as dataset characteristics, training strategy and model responses. Therefore, a comprehensive analysis is required to determine model ability and the efficiency of the considered strategies. This study implemented ten benchmark machine learning models on seventeen varied datasets. Experiments are performed using four different training strategies 60:40, 70:30, and 80:20 hold-out and five-fold cross-validation techniques. We used three evaluation metrics to evaluate the experimental results: mean squared error, mean absolute error, and coefficient of determination (R2 score). The considered models are analyzed, and each model's advantages, disadvantages, and data dependencies are indicated. As a result of performed excess number of experiments, the deep Long-Short Term Memory (LSTM) neural network outperformed other considered models, namely, decision tree, linear regression, support vector regression with a linear and radial basis function kernels, random forest, gradient boosting, extreme gradient boosting, shallow neural network, and deep neural network. It has also been shown that cross-validation has a tremendous impact on the results of the experiments and should be considered for the model evaluation in regression studies where data mining or selection is not performed.
Zitieren
APA
Sekeroglu, B., Ever, Y. K., Dimililer, K., & Al-Turjman, F. (2022). Comparative Evaluation and Comprehensive Analysis of Machine Learning Models for Regression Problems. Data Intelligence, 4(3), 620-652. https://doi.org/10.1162/dint_a_00155
Vancouver
Sekeroglu B, Ever YK, Dimililer K, Al-Turjman F. Comparative Evaluation and Comprehensive Analysis of Machine Learning Models for Regression Problems. Data Intelligence. 2022;4(3):620-652. doi:10.1162/dint_a_00155
BibTeX
@article{Sekeroglu2022,
author = {Sekeroglu, Boran and Ever, Yoney Kirsal and Dimililer, Kamil and Al-Turjman, Fadi},
title = {Comparative Evaluation and Comprehensive Analysis of Machine Learning Models for Regression Problems},
journal = {Data Intelligence},
year = {2022},
volume = {4},
number = {3},
pages = {620--652},
doi = {10.1162/dint_a_00155}
}
EUVIMED