EUVIMEDEUVIMED entdecken
Crossref

FaaSLight : General Application-level Cold-start Latency Optimization for Function-as-a-Service in Serverless Computing

Xuanzhe Liu, Jinfeng Wen, Zhenpeng Chen, Ding Li, Junkai Chen, Yi Liu, Haoyu Wang, Xin Jin

ACM Transactions on Software Engineering and Methodology · 30.09.2023 · 32 (5) · 1-29

DOI: 10.1145/3585007 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Software Engineering and Methodology, online erschienen am 22.07.2023. Verfasst von Xuanzhe Liu und 7 weiteren Autor:innen. Die Arbeit wurde bisher 82-mal zitiert (Crossref) und nennt 114 Literaturangaben. Gefördert von: National Key Research and Development Program of China, National Natural Science Foundation of China, National Natural Science Fund.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Serverless computing is a popular cloud computing paradigm that frees developers from server management. Function-as-a-Service (FaaS) is the most popular implementation of serverless computing, representing applications as event-driven and stateless functions. However, existing studies report that functions of FaaS applications severely suffer from cold-start latency. In this article, we propose an approach, namely, FaaSLight , to accelerating the cold start for FaaS applications through application-level optimization. We first conduct a measurement study to investigate the possible root cause of the cold-start problem of FaaS. The result shows that application code loading latency is a significant overhead. Therefore, loading only indispensable code from FaaS applications can be an adequate solution. Based on this insight, we identify code related to application functionalities by constructing the function-level call graph and separate other code (i.e., optional code) from FaaS applications. The separated optional code can be loaded on demand to avoid the inaccurate identification of indispensable code causing application failure. In particular, a key principle guiding the design of FaaSLight is inherently general, i.e., platform - and language-agnostic . In practice, FaaSLight can be effectively applied to FaaS applications developed in different programming languages (Python and JavaScript), and can be seamlessly deployed on popular serverless platforms such as AWS Lambda and Google Cloud Functions, without having to modify the underlying OSes or hypervisors, nor introducing any additional manual engineering efforts to developers. The evaluation results on real-world FaaS applications show that FaaSLight can significantly reduce the code loading latency (up to 78.95%, 28.78% on average), thereby reducing the cold-start latency. As a result, the total response latency of functions can be decreased by up to 42.05% (19.21% on average). Compared with the state-of-the-art, FaaSLight achieves a 21.25× improvement in reducing the average total response latency.

Förderung

  • National Key Research and Development Program of China
  • National Natural Science Foundation of China
  • National Natural Science Fund
  • Excellent Young Scientists Fund Program
  • ERC Advanced Grant

Zitieren

APA

Liu, X., Wen, J., Chen, Z., Li, D., Chen, J., Liu, Y., Wang, H., & Jin, X. (2023). FaaSLight : General Application-level Cold-start Latency Optimization for Function-as-a-Service in Serverless Computing. ACM Transactions on Software Engineering and Methodology, 32(5), 1-29. https://doi.org/10.1145/3585007

Vancouver

Liu X, Wen J, Chen Z, Li D, Chen J, Liu Y, et al. FaaSLight : General Application-level Cold-start Latency Optimization for Function-as-a-Service in Serverless Computing. ACM Transactions on Software Engineering and Methodology. 2023;32(5):1-29. doi:10.1145/3585007

BibTeX
@article{Liu2023,
  author = {Liu, Xuanzhe and Wen, Jinfeng and Chen, Zhenpeng and Li, Ding and Chen, Junkai and Liu, Yi and Wang, Haoyu and Jin, Xin},
  title = {FaaSLight : General Application-level Cold-start Latency Optimization for Function-as-a-Service in Serverless Computing},
  journal = {ACM Transactions on Software Engineering and Methodology},
  year = {2023},
  volume = {32},
  number = {5},
  pages = {1--29},
  doi = {10.1145/3585007}
}
Kostenlos starten →