EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Comparative Analysis of Machine Learning and Classical Statistical Methods for Predictive Modeling in Small Datasets

Maria Malik

Precision Journal of Applied Mathematics and Statistics · 18.09.2026 · 1 · 1

DOI: 10.67887/pd2601208002 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Precision Journal of Applied Mathematics and Statistics, online erschienen am 18.09.2026. Verfasst von Maria Malik. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 87 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Introduction

This paper conducted a comparative study that evaluated classical statistical and modern machine-learning regression models of small sample predictive modeling using the Concrete Compressive Strength (n = 100) data. Methodology: The current research used a powerful nested cross-validation model which used conformal prediction to measure both predictive accuracy and uncertainty calibration. It compared five of them, namely Ordinary Least Squares (OLS), Ridge, Lasso, Support Vector Regression (SVR) and Random Forest, based on performance measures such as Mean Absolute Error (MAE), Root Mean Squared Error (RMSE), Coefficient of Determination (R2) and coverage-width measures of 95 percent prediction intervals.

Results

The results indicated that Ridge Regression was most balanced (RMSE = 8.54 MPa; R2 = 0.735), and slightly higher compared to OLS and Lasso, and the confidence issues were narrower and more reliable. The constrained sample regime had greater variance of machine-learning models, as is expected of any small-sample sensitive model. The Friedman 2 -test failed to show statistically significant difference in ranks (p = 0.406), yet the regular hierarchy revealed that regularized linear models performed better in the low-data-density case.

Conclusion

The scientific article presented a reproducible open-source system that was used to nest validation, conformal uncertainty estimation, and regularization-based modeling, based on which the methodology of predictive analytics in low-data regimes is clearly presented. Increasingly larger multivariate datasets and Bayesian techniques and explainable AI should be used to enhance interpretability and generalizability, yet future researchers are advised to construct this pipeline.

Zitieren

APA

Malik, M. (2026). Comparative Analysis of Machine Learning and Classical Statistical Methods for Predictive Modeling in Small Datasets. Precision Journal of Applied Mathematics and Statistics, 1, 1. https://doi.org/10.67887/pd2601208002

Vancouver

Malik M. Comparative Analysis of Machine Learning and Classical Statistical Methods for Predictive Modeling in Small Datasets. Precision Journal of Applied Mathematics and Statistics. 2026;1:1. doi:10.67887/pd2601208002

BibTeX
@article{Malik2026,
  author = {Malik, Maria},
  title = {Comparative Analysis of Machine Learning and Classical Statistical Methods for Predictive Modeling in Small Datasets},
  journal = {Precision Journal of Applied Mathematics and Statistics},
  year = {2026},
  volume = {1},
  pages = {1},
  doi = {10.67887/pd2601208002}
}
Kostenlos starten →