Adaptive Caching and Request Routing for Latency-Sensitive Serverless Applications
Academic Journal of Applied Sciences · 16.11.2026 · 3 (3) · 47-53
DOI: 10.54097/nnt69h42 ↗Kurz gefasst
Fachartikel in der Zeitschrift Academic Journal of Applied Sciences, online erschienen am 16.11.2026. Verfasst von Sophie van Leeuwen und 2 weiteren Autor:innen. Die Arbeit nennt 60 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
Cold-start overhead and uneven placement of warm function instances can amplify request latency in serverless deployments. This paper studies a compact joint policy, AJR-ARF, combining latency-aware routing with a decayed recency-frequency warm-instance cache. At each arrival, the dispatcher estimates network, queueing, execution, and initialization components; after dispatch, a node replaces the cached function with the largest popularity-adjusted idle age. The method does not require offline training or workload forecasts. A deterministic discrete-event simulator was executed on changing-popularity synthetic requests across six nodes. Across five random seeds, the proposed policy produced 298.6 ms mean per-run 95th-percentile response latency, compared with 597.6 ms for nearest-node LRU, 392.3 ms for queue-aware LRU, and 302.8 ms for cache-aware LRU. The experiments also report cold-start frequency, SLO attainment, and sensitivity to cache capacity, traffic intensity, and popularity skew. The large reduction comes primarily from warm-state-aware routing, while adaptive eviction provides a smaller incremental change under this model.
Zitieren
APA
Leeuwen, S. V., Vermeer, D., & Jansen, I. (2026). Adaptive Caching and Request Routing for Latency-Sensitive Serverless Applications. Academic Journal of Applied Sciences, 3(3), 47-53. https://doi.org/10.54097/nnt69h42
Vancouver
Leeuwen SV, Vermeer D, Jansen I. Adaptive Caching and Request Routing for Latency-Sensitive Serverless Applications. Academic Journal of Applied Sciences. 2026;3(3):47-53. doi:10.54097/nnt69h42
BibTeX
@article{Leeuwen2026,
author = {Leeuwen, Sophie van and Vermeer, Daan and Jansen, Iris},
title = {Adaptive Caching and Request Routing for Latency-Sensitive Serverless Applications},
journal = {Academic Journal of Applied Sciences},
year = {2026},
volume = {3},
number = {3},
pages = {47--53},
doi = {10.54097/nnt69h42}
}
EUVIMED