Adaptive Context Caching for IoT-Based Applications: A Reinforcement Learning Approach
Sensors · 15.05.2023 · 23 (10) · 4767
DOI: 10.3390/s23104767 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 15.05.2023. Verfasst von Shakthi Weerasinghe und 5 weiteren Autor:innen. Beteiligte Einrichtung: School of Information Technology, Deakin University, Geelong, VIC 3145, Australia. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 53 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Australian Research Council.
Abstract (Originalsprache)
Making internet-of-things (IoT)-based applications context-aware demands large amounts of raw data to be collected, interpreted, stored, and reused or repurposed if needed from many domains and applications. Context is transient but interpreted data can be distinguished from IoT data in many aspects. Managing context in cache is a novel area of research that has been given very little attention. Performance metric-driven adaptive context caching (ACOCA) can have a profound impact on the performance and cost efficiency of context-management platforms (CMPs) when responding to context queries in realtime. Our paper proposes an ACOCA mechanism to maximize both the cost and performance efficiency of a CMP in near realtime. Our novel mechanism encompasses the entire context-management life cycle. This, in turn, distinctively addresses the problems of efficiently selecting context for caching and managing the additional costs of context management in the cache. We demonstrate that our mechanism results in long-term efficiencies for the CMP that have not been observed in any previous study. The mechanism employs a novel, scalable, and selective context-caching agent implemented using the twin delayed deep deterministic policy gradient method. It further incorporates an adaptive context-refresh switching policy, a time-aware eviction policy, and a latent caching decision management policy. We point out in our findings that the additional complexity of adaptation introduced to the CMP through ACOCA is significantly justified, considering the cost and performance gains achieved. Our algorithm is evaluated using a real-world inspired heterogeneous context-query load and a data set based on parking-related traffic in Melbourne, Australia. This paper presents and benchmarks the proposed scheme against traditional and context-aware caching policies. We demonstrate that ACOCA outperforms the benchmarks in both cost and performance efficiency, i.e., up to 68.6%, 84.7%, and 67% more cost efficient compared to traditional data caching policies to cache context, redirector mode, and context-aware adaptive data caching under real-world-like circumstances.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Information Technology, Deakin University, Geelong, VIC 3145, Australia.
ORCID-Profile: Shakthi Weerasinghe, Arkady Zaslavsky, Seng Wai Loke, Alexey Medvedev
Förderung
- Australian Research Council
Zitieren
APA
Weerasinghe, S., Zaslavsky, A., Loke, S. W., Hassani, A., Medvedev, A., & Abken, A. (2023). Adaptive Context Caching for IoT-Based Applications: A Reinforcement Learning Approach. Sensors, 23(10), 4767. https://doi.org/10.3390/s23104767
Vancouver
Weerasinghe S, Zaslavsky A, Loke SW, Hassani A, Medvedev A, Abken A. Adaptive Context Caching for IoT-Based Applications: A Reinforcement Learning Approach. Sensors. 2023;23(10):4767. doi:10.3390/s23104767
BibTeX
@article{Weerasinghe2023,
author = {Weerasinghe, Shakthi and Zaslavsky, Arkady and Loke, Seng Wai and Hassani, Alireza and Medvedev, Alexey and Abken, Amin},
title = {Adaptive Context Caching for IoT-Based Applications: A Reinforcement Learning Approach},
journal = {Sensors},
year = {2023},
volume = {23},
number = {10},
pages = {4767},
doi = {10.3390/s23104767}
}
EUVIMED