A Hierarchical Gradient Tracking Algorithm for Mitigating Subnet-Drift in Fog Learning Networks
IEEE Transactions on Networking · 2026 · 34 · 4684-4699
DOI: 10.1109/ton.2026.3673208 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Networking, 2026. Verfasst von Evan Chen und 2 weiteren Autor:innen. Die Arbeit nennt 60 Literaturangaben. Gefördert von: National Science Foundation, the Defense Advanced Research Projects Agency, Office of Naval Research.
Abstract (Originalsprache)
Federated learning (FL) encounters scalability challenges when implemented over fog networks that do not follow FL’s conventional star topology architecture. Semi-decentralized FL (SD-FL) has proposed a solution for device-to-device (D2D) enabled networks that divides model cooperation into two stages: at the lower stage, D2D communications is employed for local model aggregations within subnetworks (subnets), while the upper stage handles device-server (DS) communications for global model aggregations. However, existing SD-FL schemes are based on gradient diversity assumptions that become performance bottlenecks as data distributions become more heterogeneous. In this work, we develop semi-decentralized gradient tracking (SD-GT), the first SD-FL methodology that removes the need for such assumptions by incorporating tracking terms into device updates for each communication layer. Our analytical characterization of SD-GT reveals upper bounds on convergence for non-convex, convex, and strongly-convex problems. We show how the bounds enable the development of an optimization algorithm that navigates the performance-efficiency trade-off by tuning subnet sampling rate and D2D rounds for each global training interval. Our subsequent numerical evaluations demonstrate that SD-GT obtains substantial improvements in trained model quality and communication cost relative to baselines in SD-FL and gradient tracking on several datasets.
Förderung
- National Science Foundation
- the Defense Advanced Research Projects Agency
- Office of Naval Research
- Air Force Office of Scientific Research
Zitieren
APA
Chen, E., Wang, S., & Brinton, C. G. (2026). A Hierarchical Gradient Tracking Algorithm for Mitigating Subnet-Drift in Fog Learning Networks. IEEE Transactions on Networking, 34, 4684-4699. https://doi.org/10.1109/ton.2026.3673208
Vancouver
Chen E, Wang S, Brinton CG. A Hierarchical Gradient Tracking Algorithm for Mitigating Subnet-Drift in Fog Learning Networks. IEEE Transactions on Networking. 2026;34:4684-4699. doi:10.1109/ton.2026.3673208
BibTeX
@article{Chen2026,
author = {Chen, Evan and Wang, Shiqiang and Brinton, Christopher G.},
title = {A Hierarchical Gradient Tracking Algorithm for Mitigating Subnet-Drift in Fog Learning Networks},
journal = {IEEE Transactions on Networking},
year = {2026},
volume = {34},
pages = {4684--4699},
doi = {10.1109/ton.2026.3673208}
}
EUVIMED