EUVIMEDEUVIMED entdecken
Crossref

Adaptive Contextual Caching for Mobile-Edge Large Language Model Service: A Proposed Framework

Guangyuan Liu, Yinqiu Liu, Jiacheng Wang, Hongyang Du, Dusit Niyato, Jiawen Kang, Zehui Xiong

IEEE Vehicular Technology Magazine · 2026-06 · 21 (2) · 120-130

DOI: 10.1109/mvt.2025.3608414 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Vehicular Technology Magazine, 2026-06. Verfasst von Guangyuan Liu und 6 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 15 Literaturangaben. Gefördert von: Singapore Ministry of Education (MOE) Tier 1.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Mobile-edge large language model (LLM) deployments face inherent constraints, such as limited computational resources and network bandwidth. Although retrieval-augmented generation (RAG) mitigates some challenges by integrating external knowledge bases, inefficient cache management still causes high retrieval latency and frequent cache updates. To address these issues, we propose an Adaptive Contextual Caching (ACC) framework that anticipates user needs by proactively caching semantically relevant data for mobile-edge LLMs. ACC utilizes a deep reinforcement learning (DRL) module to refine cache replacement policies, balancing user context, document similarity, and the overhead associated with cache misses. Experimental results demonstrate that ACC increases cache hit rates to more than 80% after only 11 training episodes, outperforming First In, First Out (FIFO), Least Recently Used (LRU), and semantic-only caching while reducing retrieval latency by up to 40%. In particular, ACC also reduces local caching overhead (i.e., the cost of updating the cache when a miss occurs) by as much as 55%, enabling scalable and low-latency LLM services in resource-constrained edge environments.

Förderung

  • Singapore Ministry of Education (MOE) Tier 1

Zitieren

APA

Liu, G., Liu, Y., Wang, J., Du, H., Niyato, D., Kang, J., & Xiong, Z. (2026). Adaptive Contextual Caching for Mobile-Edge Large Language Model Service: A Proposed Framework. IEEE Vehicular Technology Magazine, 21(2), 120-130. https://doi.org/10.1109/mvt.2025.3608414

Vancouver

Liu G, Liu Y, Wang J, Du H, Niyato D, Kang J, et al. Adaptive Contextual Caching for Mobile-Edge Large Language Model Service: A Proposed Framework. IEEE Vehicular Technology Magazine. 2026;21(2):120-130. doi:10.1109/mvt.2025.3608414

BibTeX
@article{Liu2026,
  author = {Liu, Guangyuan and Liu, Yinqiu and Wang, Jiacheng and Du, Hongyang and Niyato, Dusit and Kang, Jiawen and Xiong, Zehui},
  title = {Adaptive Contextual Caching for Mobile-Edge Large Language Model Service: A Proposed Framework},
  journal = {IEEE Vehicular Technology Magazine},
  year = {2026},
  volume = {21},
  number = {2},
  pages = {120--130},
  doi = {10.1109/mvt.2025.3608414}
}
Kostenlos starten →