DSA: Efficient Data-Plane Memory Scheduler for In-Network Aggregation to Accelerate Distributed Training
IEEE Transactions on Networking · 2026 · 34 · 753-766
DOI: 10.1109/ton.2025.3607725 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Networking, 2026. Verfasst von Jinbin Hu und 5 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 57 Literaturangaben. Gefördert von: Hong Kong RGC, ITC ACCESS project, National Natural Science Foundation of China.
Abstract (Originalsprache)
To reduce the traffic volume and accelerate communication in distributed training (DT) jobs, recent works introduce In-Network Aggregation (INA) to move the gradient summation into network programmable switches. However, switch memory is a scarce resource, unable to support massive DT jobs in data centers, and existing INA solutions have not utilized switch memory to the best extent. We propose DSA, an Efficient Data-Plane switch memory Scheduler for in-network Aggregation. DSA introduces preemption to the switch memory management for INA jobs. Furthermore, under packet preemption scenarios, DSA optimizes the selective retransmission mechanism to reduce redundant retransimtting packets to alleviate congestion. In the data plane, DSA allows gradient tensors with high priority to preempt the switch aggregators (basic computation unit in INA) from tensors with low priority, which avoids an aggregator wasting time in idle. In the control plane, DSA devises a priority policy which assigns high priority to gradient tensors that benefit overall job efficiency more, e.g., communication-intensive jobs. We implement the prototype of DSA. The experimental results show that DSA can improve the average job completion time (JCT) by up to $1.35\times $ compared with baseline solutions.
Förderung
- Hong Kong RGC
- ITC ACCESS project
- National Natural Science Foundation of China
- Natural Science Foundation of Hunan Province
- Science and Technology Project of Hunan Provincial Water Resources Department
- New Generation Information Technology Innovation Project 2023
Zitieren
APA
Hu, J., Xu, X., Wang, H., Chen, X., Wang, J., & Chen, K. (2026). DSA: Efficient Data-Plane Memory Scheduler for In-Network Aggregation to Accelerate Distributed Training. IEEE Transactions on Networking, 34, 753-766. https://doi.org/10.1109/ton.2025.3607725
Vancouver
Hu J, Xu X, Wang H, Chen X, Wang J, Chen K. DSA: Efficient Data-Plane Memory Scheduler for In-Network Aggregation to Accelerate Distributed Training. IEEE Transactions on Networking. 2026;34:753-766. doi:10.1109/ton.2025.3607725
BibTeX
@article{Hu2026,
author = {Hu, Jinbin and Xu, Xinming and Wang, Hao and Chen, Xiaolin and Wang, Jin and Chen, Kai},
title = {DSA: Efficient Data-Plane Memory Scheduler for In-Network Aggregation to Accelerate Distributed Training},
journal = {IEEE Transactions on Networking},
year = {2026},
volume = {34},
pages = {753--766},
doi = {10.1109/ton.2025.3607725}
}
EUVIMED