EUVIMEDEUVIMED entdecken
Crossref

DSA: Efficient Data-Plane Memory Scheduler for In-Network Aggregation to Accelerate Distributed Training

Jinbin Hu, Xinming Xu, Hao Wang, Xiaolin Chen, Jin Wang, Kai Chen

IEEE Transactions on Networking · 2026 · 34 · 753-766

DOI: 10.1109/ton.2025.3607725 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Networking, 2026. Verfasst von Jinbin Hu und 5 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 57 Literaturangaben. Gefördert von: Hong Kong RGC, ITC ACCESS project, National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

To reduce the traffic volume and accelerate communication in distributed training (DT) jobs, recent works introduce In-Network Aggregation (INA) to move the gradient summation into network programmable switches. However, switch memory is a scarce resource, unable to support massive DT jobs in data centers, and existing INA solutions have not utilized switch memory to the best extent. We propose DSA, an Efficient Data-Plane switch memory Scheduler for in-network Aggregation. DSA introduces preemption to the switch memory management for INA jobs. Furthermore, under packet preemption scenarios, DSA optimizes the selective retransmission mechanism to reduce redundant retransimtting packets to alleviate congestion. In the data plane, DSA allows gradient tensors with high priority to preempt the switch aggregators (basic computation unit in INA) from tensors with low priority, which avoids an aggregator wasting time in idle. In the control plane, DSA devises a priority policy which assigns high priority to gradient tensors that benefit overall job efficiency more, e.g., communication-intensive jobs. We implement the prototype of DSA. The experimental results show that DSA can improve the average job completion time (JCT) by up to $1.35\times $ compared with baseline solutions.

Förderung

  • Hong Kong RGC
  • ITC ACCESS project
  • National Natural Science Foundation of China
  • Natural Science Foundation of Hunan Province
  • Science and Technology Project of Hunan Provincial Water Resources Department
  • New Generation Information Technology Innovation Project 2023

Zitieren

APA

Hu, J., Xu, X., Wang, H., Chen, X., Wang, J., & Chen, K. (2026). DSA: Efficient Data-Plane Memory Scheduler for In-Network Aggregation to Accelerate Distributed Training. IEEE Transactions on Networking, 34, 753-766. https://doi.org/10.1109/ton.2025.3607725

Vancouver

Hu J, Xu X, Wang H, Chen X, Wang J, Chen K. DSA: Efficient Data-Plane Memory Scheduler for In-Network Aggregation to Accelerate Distributed Training. IEEE Transactions on Networking. 2026;34:753-766. doi:10.1109/ton.2025.3607725

BibTeX
@article{Hu2026,
  author = {Hu, Jinbin and Xu, Xinming and Wang, Hao and Chen, Xiaolin and Wang, Jin and Chen, Kai},
  title = {DSA: Efficient Data-Plane Memory Scheduler for In-Network Aggregation to Accelerate Distributed Training},
  journal = {IEEE Transactions on Networking},
  year = {2026},
  volume = {34},
  pages = {753--766},
  doi = {10.1109/ton.2025.3607725}
}
Kostenlos starten →