EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Adaptive Context Caching for IoT-Based Applications: A Reinforcement Learning Approach

Shakthi Weerasinghe iD, Arkady Zaslavsky iD, Seng Wai Loke iD, Alireza Hassani, Alexey Medvedev iD, Amin Abken

Sensors · 15.05.2023 · 23 (10) · 4767

DOI: 10.3390/s23104767 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 15.05.2023. Verfasst von Shakthi Weerasinghe und 5 weiteren Autor:innen. Beteiligte Einrichtung: School of Information Technology, Deakin University, Geelong, VIC 3145, Australia. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 53 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Australian Research Council.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Making internet-of-things (IoT)-based applications context-aware demands large amounts of raw data to be collected, interpreted, stored, and reused or repurposed if needed from many domains and applications. Context is transient but interpreted data can be distinguished from IoT data in many aspects. Managing context in cache is a novel area of research that has been given very little attention. Performance metric-driven adaptive context caching (ACOCA) can have a profound impact on the performance and cost efficiency of context-management platforms (CMPs) when responding to context queries in realtime. Our paper proposes an ACOCA mechanism to maximize both the cost and performance efficiency of a CMP in near realtime. Our novel mechanism encompasses the entire context-management life cycle. This, in turn, distinctively addresses the problems of efficiently selecting context for caching and managing the additional costs of context management in the cache. We demonstrate that our mechanism results in long-term efficiencies for the CMP that have not been observed in any previous study. The mechanism employs a novel, scalable, and selective context-caching agent implemented using the twin delayed deep deterministic policy gradient method. It further incorporates an adaptive context-refresh switching policy, a time-aware eviction policy, and a latent caching decision management policy. We point out in our findings that the additional complexity of adaptation introduced to the CMP through ACOCA is significantly justified, considering the cost and performance gains achieved. Our algorithm is evaluated using a real-world inspired heterogeneous context-query load and a data set based on parking-related traffic in Melbourne, Australia. This paper presents and benchmarks the proposed scheme against traditional and context-aware caching policies. We demonstrate that ACOCA outperforms the benchmarks in both cost and performance efficiency, i.e., up to 68.6%, 84.7%, and 67% more cost efficient compared to traditional data caching policies to cache context, redirector mode, and context-aware adaptive data caching under real-world-like circumstances.

Schlagwörter

Stichwörter der Autor:innen

adaptive context cachingcontext-awarenessinternet of thingsreinforcement learning

Autor:innen und Institutionen

  • School of Information Technology, Deakin University, Geelong, VIC 3145, Australia.

ORCID-Profile: Shakthi Weerasinghe, Arkady Zaslavsky, Seng Wai Loke, Alexey Medvedev

Förderung

  • Australian Research Council

Zitieren

APA

Weerasinghe, S., Zaslavsky, A., Loke, S. W., Hassani, A., Medvedev, A., & Abken, A. (2023). Adaptive Context Caching for IoT-Based Applications: A Reinforcement Learning Approach. Sensors, 23(10), 4767. https://doi.org/10.3390/s23104767

Vancouver

Weerasinghe S, Zaslavsky A, Loke SW, Hassani A, Medvedev A, Abken A. Adaptive Context Caching for IoT-Based Applications: A Reinforcement Learning Approach. Sensors. 2023;23(10):4767. doi:10.3390/s23104767

BibTeX
@article{Weerasinghe2023,
  author = {Weerasinghe, Shakthi and Zaslavsky, Arkady and Loke, Seng Wai and Hassani, Alireza and Medvedev, Alexey and Abken, Amin},
  title = {Adaptive Context Caching for IoT-Based Applications: A Reinforcement Learning Approach},
  journal = {Sensors},
  year = {2023},
  volume = {23},
  number = {10},
  pages = {4767},
  doi = {10.3390/s23104767}
}
Kostenlos starten →