Balancing Communication and Acceleration: Exact One-to-One Optimization for Distributed Multiagent Learning Systems
IEEE Transactions on Cybernetics · 2026-04 · 56 (4) · 1817-1830
DOI: 10.1109/tcyb.2026.3665573 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Cybernetics, 2026-04. Verfasst von Ping Fan und 4 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 55 Literaturangaben. Gefördert von: Outstanding Young and Middle-Aged Science and Technology Innovation Team of Universities in Hubei Province, University–Industry Collaborative Innovation Fund of China.
Abstract (Originalsprache)
This article investigates optimization-driven learning techniques to address the critical challenge of balancing communication efficiency with convergence acceleration in distributed multiagent systems. While existing accelerated methods typically necessitate multiple internode communications per iteration, we propose two novel methods, heavy-ball exact fusion (HBEF) and Nesterov-accelerated exact fusion (NAEF), that maintain a single-communication operation while achieving enhanced convergence. By fusing momentum mechanisms with bias correction, the developed methods not only precisely preserve convergence guarantees but also demonstrate accelerated convergence compared to baseline exact diffusion and contemporary accelerated counterparts. A distinctive dual acceleration method is further proposed through momentum parameter coordination. Rigorous convergence analysis reveals the momentum parameter's critical role in acceleration behavior. Extensive numerical evaluations across representative machine learning tasks validate the proposed methods' superiority in both transient convergence speed and steady-state accuracy. Notably, they achieve state-of-the-art performance at half or one-third the communication cost, effectively bridging the long-standing gap between communication efficiency and rapid convergence in distributed learning.
Förderung
- Outstanding Young and Middle-Aged Science and Technology Innovation Team of Universities in Hubei Province
- University–Industry Collaborative Innovation Fund of China
Zitieren
APA
Fan, P., Wu, M., Liao, H., Jin, J., & Xiong, N. N. (2026). Balancing Communication and Acceleration: Exact One-to-One Optimization for Distributed Multiagent Learning Systems. IEEE Transactions on Cybernetics, 56(4), 1817-1830. https://doi.org/10.1109/tcyb.2026.3665573
Vancouver
Fan P, Wu M, Liao H, Jin J, Xiong NN. Balancing Communication and Acceleration: Exact One-to-One Optimization for Distributed Multiagent Learning Systems. IEEE Transactions on Cybernetics. 2026;56(4):1817-1830. doi:10.1109/tcyb.2026.3665573
BibTeX
@article{Fan2026,
author = {Fan, Ping and Wu, Mou and Liao, Haibin and Jin, Jianzhi and Xiong, Neal N},
title = {Balancing Communication and Acceleration: Exact One-to-One Optimization for Distributed Multiagent Learning Systems},
journal = {IEEE Transactions on Cybernetics},
year = {2026},
volume = {56},
number = {4},
pages = {1817--1830},
doi = {10.1109/tcyb.2026.3665573}
}
EUVIMED