EUVIMEDEUVIMED entdecken
Crossref

Exploring Function Granularity for Serverless Machine Learning Application with GPU Sharing

Xinning Hui, Yuanchao Xu, Xipeng Shen

Proceedings of the ACM on Measurement and Analysis of Computing Systems · 06.03.2025 · 9 (1) · 1-28

DOI: 10.1145/3711699 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the ACM on Measurement and Analysis of Computing Systems, online erschienen am 10.03.2025. Verfasst von Xinning Hui und 2 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 83 Literaturangaben. Gefördert von: NSF.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Recent years have witnessed increasing interest in machine learning (ML) inferences on serverless computing due to its auto-scaling and cost-effective properties. However, one critical aspect, function granularity, has been largely overlooked, limiting the potential of serverless ML. This paper explores the impact of function granularity on serverless ML, revealing its important effects on the SLO hit rates and resource costs of serverless applications. It further proposes adaptive granularity as an approach to addressing the phenomenon that no single granularity fits all applications and situations. It explores three predictive models and presents programming tools and runtime extensions to facilitate the integration of adaptive granularity into existing serverless platforms. Experiments show adaptive granularity produces up to a 29.2% improvement in SLO hit rates and up to a 24.6% reduction in resource costs over the state-of-the-art serverless ML which uses fixed granularity.

Förderung

  • NSF

Zitieren

APA

Hui, X., Xu, Y., & Shen, X. (2025). Exploring Function Granularity for Serverless Machine Learning Application with GPU Sharing. Proceedings of the ACM on Measurement and Analysis of Computing Systems, 9(1), 1-28. https://doi.org/10.1145/3711699

Vancouver

Hui X, Xu Y, Shen X. Exploring Function Granularity for Serverless Machine Learning Application with GPU Sharing. Proceedings of the ACM on Measurement and Analysis of Computing Systems. 2025;9(1):1-28. doi:10.1145/3711699

BibTeX
@article{Hui2025,
  author = {Hui, Xinning and Xu, Yuanchao and Shen, Xipeng},
  title = {Exploring Function Granularity for Serverless Machine Learning Application with GPU Sharing},
  journal = {Proceedings of the ACM on Measurement and Analysis of Computing Systems},
  year = {2025},
  volume = {9},
  number = {1},
  pages = {1--28},
  doi = {10.1145/3711699}
}
Kostenlos starten →