EUVIMEDEUVIMED entdecken
Crossref

Hybrid Switching Optimization Strategy for Efficient Training of Deep Neural Networks on the MNIST Dataset

Harish Kunder

Anusandhanvallari · 16.07.2026 · 4838-4848

DOI: 10.52783/anuval.2047 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Anusandhanvallari, online erschienen am 16.07.2026. Verfasst von Harish Kunder.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Deep neural networks often encounter non-convex optimization challenges during training due to the presence of local minima, saddle points, and complex loss surfaces. Existing optimization algorithms such as Adam and Stochastic Gradient Descent (SGD) offer complementary advantages—Adam provides faster convergence, while SGD tends to achieve better generalization. However, neither optimizer alone effectively balances both properties in non-convex settings. To address this limitation, this paper proposes a phase-switch hybrid optimization strategy that combines the strengths of Adam and SGD. The proposed method employs Adam during the initial phase of training to enable rapid convergence and efficient exploration of the loss landscape, and then switches to momentum-based SGD in the later phase to improve generalization and ensure stable convergence. The effectiveness of the proposed approach is evaluated on one benchmark dataset, MNIST dataset, under different learning rate settings. Experimental results demonstrate that the proposed method achieves performance that is superior or comparable to existing optimizers in terms of accuracy and loss minimization. These results indicate that the proposed hybrid optimization strategy provides a simple and effective solution for handling non-convex optimization problems in deep learning.

Zitieren

APA

Kunder, H. (2026). Hybrid Switching Optimization Strategy for Efficient Training of Deep Neural Networks on the MNIST Dataset. Anusandhanvallari, 4838-4848. https://doi.org/10.52783/anuval.2047

Vancouver

Kunder H. Hybrid Switching Optimization Strategy for Efficient Training of Deep Neural Networks on the MNIST Dataset. Anusandhanvallari. 2026:4838-4848. doi:10.52783/anuval.2047

BibTeX
@article{Kunder2026,
  author = {Kunder, Harish},
  title = {Hybrid Switching Optimization Strategy for Efficient Training of Deep Neural Networks on the MNIST Dataset},
  journal = {Anusandhanvallari},
  year = {2026},
  pages = {4838--4848},
  doi = {10.52783/anuval.2047}
}
Kostenlos starten →