EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Theoretical and Experimental Exploration in Permutation Randomization on Nonsmooth Nonconvex Optimization

Arif Hassan Zidan, Afrar Jahin, Yu Bao, Tianming Liu, Wei Zhang

Contemporary Mathematics · 02.04.2026 · 2382-2403

DOI: 10.37256/cm.7220268464 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Contemporary Mathematics, online erschienen am 02.04.2026. Verfasst von Arif Hassan Zidan und 4 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

While gradient-based optimizers that incorporate randomization often demonstrate superior performance on complex optimizations, the theoretical foundations of this advantage remain underexplored. A central question arises: What role does randomization play in dimension-free, nonsmooth, nonconvex optimization? To address this gap, we examine both the theoretical and empirical impact of permutation randomization within gradient-based optimization frameworks, using it as a representative case to investigate broader implications. From a theoretical perspective, our analysis reveals that permutation randomization disrupts the shrinkage behavior characteristic of gradient-based optimizers, allowing for continued progress toward the global optimum with sufficient iterations. Moreover, we prove that permutation randomization preserves the convergence rate of the underlying optimizer. Empirically, we conduct extensive numerical experiments comparing permutation-randomized optimizers with three baseline methods. These experiments span tasks such as training deep neural networks with stacked architectures and optimizing noisy objective functions. The results not only support our theoretical findings but also demonstrate the practical benefits of permutation randomization. In summary, this work provides both rigorous theoretical justification and compelling empirical evidence for the effectiveness of permutation randomization, establishing a foundation for extending such analyses to broader implications of randomized strategies.

Zitieren

APA

Zidan, A. H., Jahin, A., Bao, Y., Liu, T., & Zhang, W. (2026). A Theoretical and Experimental Exploration in Permutation Randomization on Nonsmooth Nonconvex Optimization. Contemporary Mathematics, 2382-2403. https://doi.org/10.37256/cm.7220268464

Vancouver

Zidan AH, Jahin A, Bao Y, Liu T, Zhang W. A Theoretical and Experimental Exploration in Permutation Randomization on Nonsmooth Nonconvex Optimization. Contemporary Mathematics. 2026:2382-2403. doi:10.37256/cm.7220268464

BibTeX
@article{Zidan2026,
  author = {Zidan, Arif Hassan and Jahin, Afrar and Bao, Yu and Liu, Tianming and Zhang, Wei},
  title = {A Theoretical and Experimental Exploration in Permutation Randomization on Nonsmooth Nonconvex Optimization},
  journal = {Contemporary Mathematics},
  year = {2026},
  pages = {2382--2403},
  doi = {10.37256/cm.7220268464}
}
Kostenlos starten →