ARGO+: Achieving Multi-Level Scalable GNN Training on Distributed Multi-Core Platform
IEEE Transactions on Parallel and Distributed Systems · 2026-08 · 37 (8) · 1808-1821
DOI: 10.1109/tpds.2026.3698481 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Parallel and Distributed Systems, 2026-08. Verfasst von Yi-Chien Lin und 4 weiteren Autor:innen. Die Arbeit nennt 49 Literaturangaben. Gefördert von: National Science Foundation, DEVCOM Army Research Lab, Semiconductor Research Corporation.
Abstract (Originalsprache)
Graph Neural Networks (GNNs) have emerged as powerful tools for learning from graph-structured data and are widely used in various applications such as traffic prediction, and Electronic Design Automation, among others. However, training GNNs on large-scale graphs with hundreds of millions of nodes and billions of edges is time-consuming, often requiring days or weeks on a single machine. While distributed GNN training across multiple machines has been explored to leverage greater computation and memory resources, existing approaches primarily focus on inter-machine scalability while overlooking intra-machine scalability across multiple cores. As a result, state-of-the-art distributed GNN training frameworks lead to severe resource underutilization and limited training performance in terms of epoch time. This work introduces ARGO+, a novel GNN system designed to achieve multi-level scalability for distributed GNN training by efficiently scaling across both inter- and intra-machine levels. ARGO+ features a two-level graph partitioning strategy, exploiting parallelisms across both graph topology and feature dimensions while minimizing communication overhead and ensuring balanced workloads. In addition, ARGO+ integrates NUMA-aware optimizations to enhance intra-node scalability, addressing inefficiencies in remote-socket data accessing. During runtime, ARGO+ adopts a two-stage parallel training scheme to further reduce communication overheads and instantiates multiple training processes to exploit computation-communication overlapping. We evaluate ARGO+ on a distributed multi-core CPU cluster consisting of 8 machines, each with a dual-socket 80-core Intel Xeon processor. Our results demonstrate that ARGO+ achieves up to 1.89× speedup compared with DistDGL, and 1.53-1.56× speedup compared with state-of-the-art distributed GNN training systems. In addition, ARGO+ is compatible with the Deep Graph Library (DGL), a widely used GNN framework, enabling seamless integration with existing GNN programs. Finally, while ARGO+ adopts various optimizations to improve scalability and training performance, these optimizations do not alter the semantics of the training algorithm; thus, the model accuracy and convergence remain consistent with the original implementation of the algorithm.
Förderung
- National Science Foundation
- DEVCOM Army Research Lab
- Semiconductor Research Corporation
Zitieren
APA
Lin, Y., Chen, Y., Gobriel, S., Jain, N., & Prasanna, V. (2026). ARGO+: Achieving Multi-Level Scalable GNN Training on Distributed Multi-Core Platform. IEEE Transactions on Parallel and Distributed Systems, 37(8), 1808-1821. https://doi.org/10.1109/tpds.2026.3698481
Vancouver
Lin Y, Chen Y, Gobriel S, Jain N, Prasanna V. ARGO+: Achieving Multi-Level Scalable GNN Training on Distributed Multi-Core Platform. IEEE Transactions on Parallel and Distributed Systems. 2026;37(8):1808-1821. doi:10.1109/tpds.2026.3698481
BibTeX
@article{Lin2026,
author = {Lin, Yi-Chien and Chen, Yuyang and Gobriel, Sameh and Jain, Nilesh and Prasanna, Viktor},
title = {ARGO+: Achieving Multi-Level Scalable GNN Training on Distributed Multi-Core Platform},
journal = {IEEE Transactions on Parallel and Distributed Systems},
year = {2026},
volume = {37},
number = {8},
pages = {1808--1821},
doi = {10.1109/tpds.2026.3698481}
}
EUVIMED