Enhancing Generalisation via Cascaded Inertia SGD With Learnt Hyperparameters
CAAI Transactions on Intelligence Technology · 2026-08 · 11 (4) · 1019-1027
DOI: 10.1049/cit2.70111 ↗Kurz gefasst
Fachartikel in der Zeitschrift CAAI Transactions on Intelligence Technology, online erschienen am 18.02.2026. Verfasst von Yongji Guan und 3 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
A central challenge in deep learning lies in achieving strong model generalisation, an area in which conventional optimisers such as stochastic gradient descent (SGD) often exhibit limitations, even though they ensure convergence. This paper introduces cascaded inertia SGD (CISGD), a novel optimisation algorithm specifically designed to address this challenge. The core mechanism of CISGD involves a hierarchical aggregation of historical gradients: it first accumulates past gradients and then compounds these accumulations to form multi‐stage inertial terms. This deep integration of gradient history allows the optimiser produce more stable optimisation trajectories, thereby encouraging convergence towards flatter minima that are empirically associated with improved generalisation. To enhance practicality and robustness, we further eliminate manual hyperparameter tuning through a lightweight feed‐forward neural network that automatically learns the optimal coefficients of the inertial terms, ensuring adaptability across diverse architectures and tasks. Extensive experiments on benchmark image classification and remote sensing change detection tasks demonstrate that CISGD consistently achieves superior generalisation performance compared with existing optimisers, demonstrating that CISGD achieves consistent, though moderate, improvements over standard optimisers while maintaining computational efficiency. This work offers a practical and theoretically grounded framework for automated and generalisable optimisation, promoting broader applications of adaptive deep learning in complex real‐world tasks.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Guan, Y., Zhang, S., Wang, L., & Li, E. (2026). Enhancing Generalisation via Cascaded Inertia SGD With Learnt Hyperparameters. CAAI Transactions on Intelligence Technology, 11(4), 1019-1027. https://doi.org/10.1049/cit2.70111
Vancouver
Guan Y, Zhang S, Wang L, Li E. Enhancing Generalisation via Cascaded Inertia SGD With Learnt Hyperparameters. CAAI Transactions on Intelligence Technology. 2026;11(4):1019-1027. doi:10.1049/cit2.70111
BibTeX
@article{Guan2026,
author = {Guan, Yongji and Zhang, Shunbao and Wang, Longbang and Li, Erchao},
title = {Enhancing Generalisation via Cascaded Inertia SGD With Learnt Hyperparameters},
journal = {CAAI Transactions on Intelligence Technology},
year = {2026},
volume = {11},
number = {4},
pages = {1019--1027},
doi = {10.1049/cit2.70111}
}
EUVIMED