EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

A Statistical Analysis of Classical and Advanced Regression Models in Data Science

Abdulwase Osmani, Abdul Qahar Majeedi

Integrated Journal for Research in Arts and Humanities · 29.07.2026 · 6 (4) · 196-206

DOI: 10.55544/ijrah.6.4.24 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Integrated Journal for Research in Arts and Humanities, online erschienen am 29.07.2026. Verfasst von Abdulwase Osmani und 1 weiteren Autor:innen. Die Arbeit nennt 22 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Regression models remain foundational tools of both mathematical statistics and modern applied data science for prediction, explanation, and model comparison. In applied statistical modelling there is always a fundamental practical trade-off that must be considered. Classical regression models are attractive mainly because they are easy to interpret, and are built on a well-established statistical foundation. However, they will often describe real world data very poorly when the underlying relationships are curved, interactive, or simply more complex than a simple straight-line structure. More flexible models can often deliver substantially improved prediction performance in these cases, but this improvement almost always comes at the cost of reduced interpretability and transparency. This study presents a systematic comparative analysis of classical, regularized, nonlinear, and ensemble models across two widely used benchmark datasets: the Advertising continuous sales prediction task and the Diabetes binary medical classification task. All models were evaluated using cross-validation and held-out test-set performance. Third-degree Polynomial Regression produced the strongest overall result on the Advertising dataset, with a test R² of 0.9907. Gradient Boosting achieved the highest performance on the Diabetes dataset with a test ROC-AUC of 0.8315, though Logistic Regression remained a highly competitive and far more interpretable baseline. We conclude that advanced models can outperform classical baselines when the underlying data structure is complex, while classical models remain essential for interpretation, comparison, and model selection.

Zitieren

APA

Osmani, A., & Majeedi, A. Q. (2026). A Statistical Analysis of Classical and Advanced Regression Models in Data Science. Integrated Journal for Research in Arts and Humanities, 6(4), 196-206. https://doi.org/10.55544/ijrah.6.4.24

Vancouver

Osmani A, Majeedi AQ. A Statistical Analysis of Classical and Advanced Regression Models in Data Science. Integrated Journal for Research in Arts and Humanities. 2026;6(4):196-206. doi:10.55544/ijrah.6.4.24

BibTeX
@article{Osmani2026,
  author = {Osmani, Abdulwase and Majeedi, Abdul Qahar},
  title = {A Statistical Analysis of Classical and Advanced Regression Models in Data Science},
  journal = {Integrated Journal for Research in Arts and Humanities},
  year = {2026},
  volume = {6},
  number = {4},
  pages = {196--206},
  doi = {10.55544/ijrah.6.4.24}
}
Kostenlos starten →