Analisis Visual Perilaku Agen Q-Learning dan SARSA pada Cliff Walking Problem dengan Explainable Reinforcement Learning
Bulletin of Computer Science Research · 11.02.2026 · 6 (2) · 633-642
DOI: 10.47065/bulletincsr.v6i2.984 ↗Kurz gefasst
Fachartikel in der Zeitschrift Bulletin of Computer Science Research, online erschienen am 11.02.2026. Verfasst von Firas Atqiya und 1 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Reinforcement Learning (RL) has achieved remarkable success in complex sequential decision tasks. However, modern RL models often lack explainability, creating a serious "black box" problem, especially in high-stakes domains. This study proposes a Pygame-based real-time visualization architecture for RL, and demonstrates its benefits in a Cliff Walking case study using Q-Learning and SARSA algorithms. Key contributions include: (1) a real-time visualization architecture that decouples training logic from graphics rendering with support more than 60 FPS, (2) interpretive visualization techniques including diverging heatmaps, dynamic policy arrows, and Ghost Policies, and (3) a comprehensive empirical study clarifying the distinct characteristics of both algorithms. Experimental results clearly show that Q-Learning selects an efficient but risky path aligned with its optimistic off-policy nature, while SARSA converges on a safer path reflecting its on-policy nature that considers exploration safety. Quantitatively, Q-Learning successfully achieved an optimal 13-step path with an accumulation of 10,642 falls, whereas SARSA converged to a safe 23-step path with a significantly higher collision frequency (232,844 times) to avoid extreme penalties from the cliff zone.
Zitieren
APA
Atqiya, F., & Sholahuddin, M. R. (2026). Analisis Visual Perilaku Agen Q-Learning dan SARSA pada Cliff Walking Problem dengan Explainable Reinforcement Learning. Bulletin of Computer Science Research, 6(2), 633-642. https://doi.org/10.47065/bulletincsr.v6i2.984
Vancouver
Atqiya F, Sholahuddin MR. Analisis Visual Perilaku Agen Q-Learning dan SARSA pada Cliff Walking Problem dengan Explainable Reinforcement Learning. Bulletin of Computer Science Research. 2026;6(2):633-642. doi:10.47065/bulletincsr.v6i2.984
BibTeX
@article{Atqiya2026,
author = {Atqiya, Firas and Sholahuddin, Muhammad Rizqi},
title = {Analisis Visual Perilaku Agen Q-Learning dan SARSA pada Cliff Walking Problem dengan Explainable Reinforcement Learning},
journal = {Bulletin of Computer Science Research},
year = {2026},
volume = {6},
number = {2},
pages = {633--642},
doi = {10.47065/bulletincsr.v6i2.984}
}
EUVIMED