Leveraging Graph Analysis to Pinpoint Root Causes of Scalability Issues for Parallel Applications
IEEE Transactions on Parallel and Distributed Systems · 2025-02 · 36 (2) · 308-325
DOI: 10.1109/tpds.2024.3485789 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Parallel and Distributed Systems, 2025-02. Verfasst von Yuyang Jin und 8 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 65 Literaturangaben. Gefördert von: National Key R&D Program of China, NSFC for Distinguished Young Scholar, National Natural Science Foundation of China.
Abstract (Originalsprache)
It is challenging to scale parallel applications to modern supercomputers because of load imbalance, resource contention, and communications between processes. Profiling and tracing are two main performance analysis approaches for detecting these scalability bottlenecks. Profiling is low-cost but lacks detailed dependence for identifying root causes. Tracing records plentiful information but incurs significant overheads. To address these issues, we present ScalAna, which employs static analysis techniques to combine the benefits of profiling and tracing - it enables tracing's analyzability with overhead similar to profiling. ScalAna uses static analysis to capture program structures and data dependence of parallel applications, and leverages lightweight profiling approaches to record performance data during runtime. Then a parallel performance graph is generated with both static and dynamic data. Based on this graph, we design a backtracking detection approach to automatically pinpoint the root causes of scaling issues. We evaluate the efficacy and efficiency of ScalAna using several real applications with up to 704K lines of code and demonstrate that our approach can effectively pinpoint the root causes of scaling loss with an average overhead of 5.65% for up to 16,384 processes. By fixing the root causes detected by our tool, it achieves up to 33.01% performance improvement.
Förderung
- National Key R&D Program of China
- NSFC for Distinguished Young Scholar
- National Natural Science Foundation of China
- China Postdoctoral Science Foundation
Zitieren
APA
Jin, Y., Wang, H., Tang, X., Guo, Z., Zhao, Y., Hoefler, T., Liu, T., Liu, X., & Zhai, J. (2025). Leveraging Graph Analysis to Pinpoint Root Causes of Scalability Issues for Parallel Applications. IEEE Transactions on Parallel and Distributed Systems, 36(2), 308-325. https://doi.org/10.1109/tpds.2024.3485789
Vancouver
Jin Y, Wang H, Tang X, Guo Z, Zhao Y, Hoefler T, et al. Leveraging Graph Analysis to Pinpoint Root Causes of Scalability Issues for Parallel Applications. IEEE Transactions on Parallel and Distributed Systems. 2025;36(2):308-325. doi:10.1109/tpds.2024.3485789
BibTeX
@article{Jin2025,
author = {Jin, Yuyang and Wang, Haojie and Tang, Xiongchao and Guo, Zhenhua and Zhao, Yaqian and Hoefler, Torsten and Liu, Tao and Liu, Xu and Zhai, Jidong},
title = {Leveraging Graph Analysis to Pinpoint Root Causes of Scalability Issues for Parallel Applications},
journal = {IEEE Transactions on Parallel and Distributed Systems},
year = {2025},
volume = {36},
number = {2},
pages = {308--325},
doi = {10.1109/tpds.2024.3485789}
}
EUVIMED