EUVIMEDEUVIMED entdecken
Crossref

Accelerating Distributed Training Through In-Network Aggregation and Route Selection

Hongli Xu, Baoqing Wang, Jiawei Liu, Gongming Zhao, Jin Fang, Junhong Lu, Chunming Qiao

IEEE Transactions on Computers · 2026-09 · 75 (9) · 3340-3354

DOI: 10.1109/tc.2026.3709852 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Computers, 2026-09. Verfasst von Hongli Xu und 6 weiteren Autor:innen. Die Arbeit nennt 39 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Deep learning has brought about a revolutionary transformation in network applications, particularly in domains like e-commerce and online advertising. Distributed training (DT), as a critical means to expedite model training, has progressively emerged as a key foundational infrastructure for such applications. However, with the rapid advancement of hardware accelerators, the bottleneck in DT has shifted from computation to communication. To this end, one promising approach called in-network aggregation (INA) is proposed to alleviate the bandwidth bottleneck by aggregating gradients using programmable hardware ( e . g ., Intel Tofino switches). Regrettably, current INA works primarily focus on single-PS architecture and do not fully address the communication bottleneck caused by limited PS ingress bandwidth. To bridge this gap, we propose InArt, the first work introducing INA with route selection in a multi-PS architecture. To accommodate traffic dynamics, InArt adopts a two-phase approach: splitting the DT task among multiple parameter servers and selecting appropriate routing schemes to harness INA capabilities fully. We propose Lagrange multiplier and randomized rounding algorithms for these phases, respectively. We implement InArt and evaluate its performance through experiments on physical platforms (Tofino switches) and Mininet emulation (P4 Software Switches). Compared with state-of-the-art solutions, experimental results show that InArt can reduce communication time by $\mathbf{66\%}$ 66 % on average.

Zitieren

APA

Xu, H., Wang, B., Liu, J., Zhao, G., Fang, J., Lu, J., & Qiao, C. (2026). Accelerating Distributed Training Through In-Network Aggregation and Route Selection. IEEE Transactions on Computers, 75(9), 3340-3354. https://doi.org/10.1109/tc.2026.3709852

Vancouver

Xu H, Wang B, Liu J, Zhao G, Fang J, Lu J, et al. Accelerating Distributed Training Through In-Network Aggregation and Route Selection. IEEE Transactions on Computers. 2026;75(9):3340-3354. doi:10.1109/tc.2026.3709852

BibTeX
@article{Xu2026,
  author = {Xu, Hongli and Wang, Baoqing and Liu, Jiawei and Zhao, Gongming and Fang, Jin and Lu, Junhong and Qiao, Chunming},
  title = {Accelerating Distributed Training Through In-Network Aggregation and Route Selection},
  journal = {IEEE Transactions on Computers},
  year = {2026},
  volume = {75},
  number = {9},
  pages = {3340--3354},
  doi = {10.1109/tc.2026.3709852}
}
Kostenlos starten →