Reinforcement Learning-Based Self-Healing Framework in IoT Sensor Networks
Gazi University Journal of Science Part A: Engineering and Innovation · 30.06.2026 · 13 (2) · 764-783
DOI: 10.54287/gujsa.1914900 ↗Kurz gefasst
Fachartikel in der Zeitschrift Gazi University Journal of Science Part A: Engineering and Innovation, online erschienen am 30.06.2026. Verfasst von Tunahan Timuçin. Die Arbeit nennt 30 Literaturangaben.
Abstract (Originalsprache)
The fast increase of devices in Internet of Things (IoT) networks, which is projected to grow to over 21 billion devices by 2025, will require more sophisticated management paradigms, as current rule-based and reactive frameworks cannot support networks of this scale. Rule-based systems are capable of processing only of predefined failure patterns and when it comes to complex situations like simultaneous multiple failures and cascading failures, they cannot work. The proposed paper suggests a self-healing framework of reinforcement learning (RL) with respect to an IoT sensor network. The original innovation of the framework is that it brings the MAPE-K cycle (Monitor-Analyze-Plan-Execute over Knowledge) framework, the fundamental reference model of autonomous computing, to which a learning element is added to form the MAPE-K+L model. This aspect provides the system to be able to enhance its policy gradually through learning on the past failures. The proposed framework has been tested in a custom Python/Gymnasium simulation framework, with six failure modes (single node failure, sensor drift, gateway failure, concurrent multiple failure, network congestion, cascading failure) in cluster topology networks, using 50 to 500 nodes. The Q-Learning and Deep Q-Network (DQN) agents were fully contrasted with random (RND) and rule-based (RB) baselines. The Q-Learning agent in the multiple failure scenario decreased the mean recovery time (MTTR) by 51.9 and 32.8 percent relative to random selection and rule-based approach respectively (p<0.001, Cohen d=1.424). The DQN agent had the best cumulative reward and the most stable performance in the cascading failure case; scalability experiments proved that DQN can work with a stable performance even in the 500-node networks.
Zitieren
APA
Timuçin, T. (2026). Reinforcement Learning-Based Self-Healing Framework in IoT Sensor Networks. Gazi University Journal of Science Part A: Engineering and Innovation, 13(2), 764-783. https://doi.org/10.54287/gujsa.1914900
Vancouver
Timuçin T. Reinforcement Learning-Based Self-Healing Framework in IoT Sensor Networks. Gazi University Journal of Science Part A: Engineering and Innovation. 2026;13(2):764-783. doi:10.54287/gujsa.1914900
BibTeX
@article{Timuin2026,
author = {Timuçin, Tunahan},
title = {Reinforcement Learning-Based Self-Healing Framework in IoT Sensor Networks},
journal = {Gazi University Journal of Science Part A: Engineering and Innovation},
year = {2026},
volume = {13},
number = {2},
pages = {764--783},
doi = {10.54287/gujsa.1914900}
}
EUVIMED