EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Adaptive Caching and Request Routing for Latency-Sensitive Serverless Applications

Sophie van Leeuwen, Daan Vermeer, Iris Jansen

Academic Journal of Applied Sciences · 16.11.2026 · 3 (3) · 47-53

DOI: 10.54097/nnt69h42 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Academic Journal of Applied Sciences, online erschienen am 16.11.2026. Verfasst von Sophie van Leeuwen und 2 weiteren Autor:innen. Die Arbeit nennt 60 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Cold-start overhead and uneven placement of warm function instances can amplify request latency in serverless deployments. This paper studies a compact joint policy, AJR-ARF, combining latency-aware routing with a decayed recency-frequency warm-instance cache. At each arrival, the dispatcher estimates network, queueing, execution, and initialization components; after dispatch, a node replaces the cached function with the largest popularity-adjusted idle age. The method does not require offline training or workload forecasts. A deterministic discrete-event simulator was executed on changing-popularity synthetic requests across six nodes. Across five random seeds, the proposed policy produced 298.6 ms mean per-run 95th-percentile response latency, compared with 597.6 ms for nearest-node LRU, 392.3 ms for queue-aware LRU, and 302.8 ms for cache-aware LRU. The experiments also report cold-start frequency, SLO attainment, and sensitivity to cache capacity, traffic intensity, and popularity skew. The large reduction comes primarily from warm-state-aware routing, while adaptive eviction provides a smaller incremental change under this model.

Zitieren

APA

Leeuwen, S. V., Vermeer, D., & Jansen, I. (2026). Adaptive Caching and Request Routing for Latency-Sensitive Serverless Applications. Academic Journal of Applied Sciences, 3(3), 47-53. https://doi.org/10.54097/nnt69h42

Vancouver

Leeuwen SV, Vermeer D, Jansen I. Adaptive Caching and Request Routing for Latency-Sensitive Serverless Applications. Academic Journal of Applied Sciences. 2026;3(3):47-53. doi:10.54097/nnt69h42

BibTeX
@article{Leeuwen2026,
  author = {Leeuwen, Sophie van and Vermeer, Daan and Jansen, Iris},
  title = {Adaptive Caching and Request Routing for Latency-Sensitive Serverless Applications},
  journal = {Academic Journal of Applied Sciences},
  year = {2026},
  volume = {3},
  number = {3},
  pages = {47--53},
  doi = {10.54097/nnt69h42}
}
Kostenlos starten →