EUVIMEDEUVIMED entdecken
Crossref

SG-Serve: Efficient Model Serving for Subgraph-based Graph Representation Learning

Qihui Zhou, Peiqi Yin, Xiao Yan, Changji Li, James Cheng

Proceedings of the ACM on Management of Data · 02.04.2026 · 4 (1) · 1-29

DOI: 10.1145/3786697 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the ACM on Management of Data, online erschienen am 07.04.2026. Verfasst von Qihui Zhou und 4 weiteren Autor:innen. Die Arbeit nennt 103 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Subgraph-based graph representation learning (SGRL) is an emerging class of GNN models that achieve much higher accuracy for various tasks than classical GNN models (e.g., GCN and GAT). However, we observe that serving SGRL models for online applications is challenging due to their irregular request workloads . Specifically, some heavy requests need significantly more computation than regular requests (e.g., 100x), leading to excessively long tail latency in existing systems. As such, we build SG-Serve, which tailors subgraph extraction and model inference (i.e., the two main stages of SGRL models) to handle the irregular request workloads. For subgraph extraction on the CPU, we propose a general API to implement the diverse extraction methods of SGRL models. Beside generality, the API also exposes parallelization opportunities and allows the heavy requests to utilize multiple threads for speedup. To schedule the CPU threads to conduct extraction for concurrent requests, we design a work-stealing policy, which enjoys parallelism while avoiding head-of-line blocking. For model inference on the GPU, we batch the requests according to their workload instead of request count (i.e., as in existing systems) and run two GPU processes to prevent the heavy requests from monopolizing the GPU. Our experiments show that compared with existing systems, SG-Serve can reduce the 99th percentile (P99) latency by over 13x and improve the request throughput by over 33x.

Zitieren

APA

Zhou, Q., Yin, P., Yan, X., Li, C., & Cheng, J. (2026). SG-Serve: Efficient Model Serving for Subgraph-based Graph Representation Learning. Proceedings of the ACM on Management of Data, 4(1), 1-29. https://doi.org/10.1145/3786697

Vancouver

Zhou Q, Yin P, Yan X, Li C, Cheng J. SG-Serve: Efficient Model Serving for Subgraph-based Graph Representation Learning. Proceedings of the ACM on Management of Data. 2026;4(1):1-29. doi:10.1145/3786697

BibTeX
@article{Zhou2026,
  author = {Zhou, Qihui and Yin, Peiqi and Yan, Xiao and Li, Changji and Cheng, James},
  title = {SG-Serve: Efficient Model Serving for Subgraph-based Graph Representation Learning},
  journal = {Proceedings of the ACM on Management of Data},
  year = {2026},
  volume = {4},
  number = {1},
  pages = {1--29},
  doi = {10.1145/3786697}
}
Kostenlos starten →