Explainable and transferable deep reinforcement learning for adaptive patrol of rail-guided robot system
PeerJ Computer Science · 14.04.2026 · 12 · e3722
DOI: 10.7717/peerj-cs.3722 ↗Kurz gefasst
Fachartikel in der Zeitschrift PeerJ Computer Science, online erschienen am 14.04.2026. Verfasst von Hosun Lee und 3 weiteren Autor:innen. Die Arbeit nennt 26 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: National Research Foundation of Korea, Kwangwoon University.
Abstract (Originalsprache)
Intelligent facility management systems can reduce the workload of human operators by enabling autonomous operation. However, the lack of transparency in existing machine learning-based systems often hinders user trust, especially in safety-critical environments such as industrial and public facilities. To ensure reliability and accountability, autonomous systems must not only perform effectively but also provide human-understandable explanations for their actions. This article presents an explainable deep reinforcement learning framework for a rail-guided patrol robot that adaptively controls its speed based on the visual complexity of its surroundings. The proposed system employs the Deep Deterministic Policy Gradient (DDPG) algorithm to learn a continuous speed-control policy directly from image-based observations. To enhance transparency, Gradient-weighted Class Activation Mapping (Grad-CAM) is integrated into the actor network to visualize which spatial regions of the input most strongly influence speed decisions, providing post hoc explanations of the model’s decisions. To support real-world deployment, we incorporate a Cycle-Consistent Generative Adversarial Network (CycleGAN)-based domain adaptation module that transforms real camera images into a simulation-compatible visual style, enabling the trained policy to operate without additional retraining. Grad-CAM is also used to assess the semantic consistency of translated images and verify that domain adaptation preserves task-relevant visual cues. Because the proposed framework is designed around lightweight visual inputs and compact neural networks, its computational demand remains modest and suitable for embedded execution. Grad-CAM analysis is used for explainability rather than for action generation, and its computation does not affect the timing of the control loop. The framework is evaluated through extensive experiments in both simulation and a physical testbed environment. Results demonstrate that the robot successfully adjusts its patrol speed in response to scene complexity and that the learned policy provides coherent and meaningful visual explanations. These findings highlight the potential of combining deep reinforcement learning, visual domain adaptation, and explainable AI to realize trustworthy and adaptable autonomous patrol systems.
Förderung
- National Research Foundation of Korea
- Kwangwoon University
Zitieren
APA
Lee, H., Kwon, J., Chong, N. Y., & Yang, W. (2026). Explainable and transferable deep reinforcement learning for adaptive patrol of rail-guided robot system. PeerJ Computer Science, 12, e3722. https://doi.org/10.7717/peerj-cs.3722
Vancouver
Lee H, Kwon J, Chong NY, Yang W. Explainable and transferable deep reinforcement learning for adaptive patrol of rail-guided robot system. PeerJ Computer Science. 2026;12:e3722. doi:10.7717/peerj-cs.3722
BibTeX
@article{Lee2026,
author = {Lee, Hosun and Kwon, Jaesung and Chong, Nak Young and Yang, Woosung},
title = {Explainable and transferable deep reinforcement learning for adaptive patrol of rail-guided robot system},
journal = {PeerJ Computer Science},
year = {2026},
volume = {12},
pages = {e3722},
doi = {10.7717/peerj-cs.3722}
}
EUVIMED