EUVIMEDOpdag EUVIMED
Open access · CC BY 4.0

Efficiency and Stability of a New Hybrid Unconstrained Optimization Algorithm with Quasi-Newton Updates and Higher-Order Methods

Alicia Cordero, Javier G. Maimó, Juan R. Torregrosa, Natanael Ureña Castillo

Mathematics · 2026-05-19 · 14 (10) · 1746

DOI: 10.3390/math14101746 ↗

At a glance

Journal article in Mathematics, published online on 2026-05-19. Written by Alicia Cordero and 3 co-authors. 42 references. The full text is freely available (open access, CC BY 4.0). Funded by: Ministerio de Educación Superior, Ciencia y Tecnología.

AbstractBibliografiske oplysningerCiteRelated studies

Abstract (original language)

We propose the higher-order quasi-Newton (HOQN) method, a hybrid algorithm for unconstrained optimization that combines Newtonian predictors with higher-order correctors derived from vector extensions of the Traub, Chun, and Ostrowski methods, along with quasi-Newton updates of the inverse Hessian using Broyden–Fletcher–Goldfarb–Shanno (BFGS) or Davidon–Fletcher–Powell (DFP) formulas. We demonstrate that the resulting scheme achieves cubic local convergence order, representing a substantial improvement over the superlinear convergence typical of classical quasi-Newton methods, while maintaining a cost of On2 per iteration. We also analyze variants that incorporate two successive quasi-Newton updates, and show that they retain the same cubic order. Numerical experiments with the benchmark functions of Himmelblau and Freudenstein–Roth confirm the theoretical convergence order and show that the hybrid variants consistently require fewer iterations than BFGS, DFP, and Symmetric Rank-One (SR1). In the case of the Booth function, given its strictly convex quadratic structure, the proposed hybrid methods reach the global minimum in just two iterations and exhibit numerical accuracy superior to that of classical quasi-Newton methods. In addition, limited-memory variants (L-HOQN) are introduced; these are evaluated during the training of a convolutional neural network on the MNIST dataset, where they achieve test accuracies exceeding 99% and outperform L-BFGS and standard stochastic gradient descent (SGD) at all tested learning rates.

Funding

  • Ministerio de Educación Superior, Ciencia y Tecnología

Cite

APA

Cordero, A., Maimó, J. G., Torregrosa, J. R., & Castillo, N. U. (2026). Efficiency and Stability of a New Hybrid Unconstrained Optimization Algorithm with Quasi-Newton Updates and Higher-Order Methods. Mathematics, 14(10), 1746. https://doi.org/10.3390/math14101746

Vancouver

Cordero A, Maimó JG, Torregrosa JR, Castillo NU. Efficiency and Stability of a New Hybrid Unconstrained Optimization Algorithm with Quasi-Newton Updates and Higher-Order Methods. Mathematics. 2026;14(10):1746. doi:10.3390/math14101746

BibTeX
@article{Cordero2026,
  author = {Cordero, Alicia and Maimó, Javier G. and Torregrosa, Juan R. and Castillo, Natanael Ureña},
  title = {Efficiency and Stability of a New Hybrid Unconstrained Optimization Algorithm with Quasi-Newton Updates and Higher-Order Methods},
  journal = {Mathematics},
  year = {2026},
  volume = {14},
  number = {10},
  pages = {1746},
  doi = {10.3390/math14101746}
}
Start for free →