EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Statistical Regularization Approach for Reducing Overfitting in Deep Neural Networks

Ruqaya Shaker Mahmood

Neutrosophic Optimization and Intelligent Systems · 24.03.2026 · 9 · 44-60

DOI: 10.61356/j.nois.2026.9651 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Neutrosophic Optimization and Intelligent Systems, online erschienen am 24.03.2026. Verfasst von Ruqaya Shaker Mahmood. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Deep Neural Networks (DNNs) have recorded impressive performance on vision and language tasks, but their overfitting nature is a major weakness, especially in low-data and high-dimensional scenarios. A new statistical regularization framework that unites penalized likelihood estimation with neural network training is suggested in this work. Specifically, the shrinkage approaches of elastic net, smoothly clipped absolute deviation (SCAD), and minimax concave penalty (MCP) are incorporated into the loss form to counter overfitting according to the model complexity. We present a conceptual study of the bias-variance trade-off of varying sample sizes and network depths with new information on statistical behavior of deep models. An extremely large-scale experiment on benchmark datasets (CIFAR-10, ImageNet, IMDB and AG News) demonstrates that the proposed scheme is significantly more effective in reducing the generalization error, in terms of stability, and insensible to adversarial perturbations than regularization schemes. These kinds of discoveries demonstrate that statistical regularization as one of the future possibilities of the reliability and interpretability of deep learning systems.

Zitieren

APA

Mahmood, R. S. (2026). A Statistical Regularization Approach for Reducing Overfitting in Deep Neural Networks. Neutrosophic Optimization and Intelligent Systems, 9, 44-60. https://doi.org/10.61356/j.nois.2026.9651

Vancouver

Mahmood RS. A Statistical Regularization Approach for Reducing Overfitting in Deep Neural Networks. Neutrosophic Optimization and Intelligent Systems. 2026;9:44-60. doi:10.61356/j.nois.2026.9651

BibTeX
@article{Mahmood2026,
  author = {Mahmood, Ruqaya Shaker},
  title = {A Statistical Regularization Approach for Reducing Overfitting in Deep Neural Networks},
  journal = {Neutrosophic Optimization and Intelligent Systems},
  year = {2026},
  volume = {9},
  pages = {44--60},
  doi = {10.61356/j.nois.2026.9651}
}
Kostenlos starten →