EUVIMEDEUVIMED entdecken
Crossref

Rethinking Serverless Keep-Alive by Decoupling Eviction Priority From Execution State

Yili Gong, Xinquan Cai, Qianlong Sang, Tianheng Lu, Chuang Hu, Dazhao Cheng

IEEE Transactions on Computers · 2026-08 · 75 (8) · 2929-2942

DOI: 10.1109/tc.2026.3699453 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Computers, 2026-08. Verfasst von Yili Gong und 5 weiteren Autor:innen. Die Arbeit nennt 44 Literaturangaben. Gefördert von: National Natural Science Foundation of China, National Key Research and Development Program of China, State Key Laboratory of Internet of Things for Smart City (University of Macau) Open Research Project.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Keeping runtime alive is critical for mitigating cold start issues in Function-as-a-Service (FaaS) platforms. State-of-the-Art (SOTA) keep-alive policies often draw an analogy to data caching, adapting classic replacement algorithms to manage runtime pools. Our analysis reveals that this analogy is fundamentally flawed: 1) they violate their own eviction priorities due to conflicts with running containers, and 2) they ignore the exorbitant memory-time resource cost of runtime replacement. To address these challenges, we present FaaShadow, a lightweight keep-alive policy that recasts the problem from simple caching to cost-aware resource allocation. FaaShadow introduces the concept of a shadow pool, a per-function data structure that enables online estimation of the marginal utility of memory adjustments. By quantifying both the potential performance gain from allocating new containers and the performance loss from removing existing ones, FaaShadow makes data-driven reallocation decisions that maximize the global warm start rate. Experimental results show that FaaShadow achieves a 95% warm start rate using only 60% of the memory required by the best-in-class baseline. When paired with our dynamic scaling mechanism, FaaShadow reduces average memory consumption by a staggering 81.71% compared to the SOTA predictive scaler, while upholding performance targets.

Förderung

  • National Natural Science Foundation of China
  • National Key Research and Development Program of China
  • State Key Laboratory of Internet of Things for Smart City (University of Macau) Open Research Project

Zitieren

APA

Gong, Y., Cai, X., Sang, Q., Lu, T., Hu, C., & Cheng, D. (2026). Rethinking Serverless Keep-Alive by Decoupling Eviction Priority From Execution State. IEEE Transactions on Computers, 75(8), 2929-2942. https://doi.org/10.1109/tc.2026.3699453

Vancouver

Gong Y, Cai X, Sang Q, Lu T, Hu C, Cheng D. Rethinking Serverless Keep-Alive by Decoupling Eviction Priority From Execution State. IEEE Transactions on Computers. 2026;75(8):2929-2942. doi:10.1109/tc.2026.3699453

BibTeX
@article{Gong2026,
  author = {Gong, Yili and Cai, Xinquan and Sang, Qianlong and Lu, Tianheng and Hu, Chuang and Cheng, Dazhao},
  title = {Rethinking Serverless Keep-Alive by Decoupling Eviction Priority From Execution State},
  journal = {IEEE Transactions on Computers},
  year = {2026},
  volume = {75},
  number = {8},
  pages = {2929--2942},
  doi = {10.1109/tc.2026.3699453}
}
Kostenlos starten →