EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Enhancing Generalisation via Cascaded Inertia SGD With Learnt Hyperparameters

Yongji Guan, Shunbao Zhang, Longbang Wang, Erchao Li

CAAI Transactions on Intelligence Technology · 2026-08 · 11 (4) · 1019-1027

DOI: 10.1049/cit2.70111 ↗

Kurz gefasst

Fachartikel in der Zeitschrift CAAI Transactions on Intelligence Technology, online erschienen am 18.02.2026. Verfasst von Yongji Guan und 3 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

A central challenge in deep learning lies in achieving strong model generalisation, an area in which conventional optimisers such as stochastic gradient descent (SGD) often exhibit limitations, even though they ensure convergence. This paper introduces cascaded inertia SGD (CISGD), a novel optimisation algorithm specifically designed to address this challenge. The core mechanism of CISGD involves a hierarchical aggregation of historical gradients: it first accumulates past gradients and then compounds these accumulations to form multi‐stage inertial terms. This deep integration of gradient history allows the optimiser produce more stable optimisation trajectories, thereby encouraging convergence towards flatter minima that are empirically associated with improved generalisation. To enhance practicality and robustness, we further eliminate manual hyperparameter tuning through a lightweight feed‐forward neural network that automatically learns the optimal coefficients of the inertial terms, ensuring adaptability across diverse architectures and tasks. Extensive experiments on benchmark image classification and remote sensing change detection tasks demonstrate that CISGD consistently achieves superior generalisation performance compared with existing optimisers, demonstrating that CISGD achieves consistent, though moderate, improvements over standard optimisers while maintaining computational efficiency. This work offers a practical and theoretically grounded framework for automated and generalisable optimisation, promoting broader applications of adaptive deep learning in complex real‐world tasks.

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Guan, Y., Zhang, S., Wang, L., & Li, E. (2026). Enhancing Generalisation via Cascaded Inertia SGD With Learnt Hyperparameters. CAAI Transactions on Intelligence Technology, 11(4), 1019-1027. https://doi.org/10.1049/cit2.70111

Vancouver

Guan Y, Zhang S, Wang L, Li E. Enhancing Generalisation via Cascaded Inertia SGD With Learnt Hyperparameters. CAAI Transactions on Intelligence Technology. 2026;11(4):1019-1027. doi:10.1049/cit2.70111

BibTeX
@article{Guan2026,
  author = {Guan, Yongji and Zhang, Shunbao and Wang, Longbang and Li, Erchao},
  title = {Enhancing Generalisation via Cascaded Inertia SGD With Learnt Hyperparameters},
  journal = {CAAI Transactions on Intelligence Technology},
  year = {2026},
  volume = {11},
  number = {4},
  pages = {1019--1027},
  doi = {10.1049/cit2.70111}
}
Kostenlos starten →