Conquering the Urban Firefighting Challenge: A Deep Q-Network Approach for Autonomous UAV Navigation
Inventions · 02.04.2026 · 11 (2) · 35
DOI: 10.3390/inventions11020035 ↗Kurz gefasst
Fachartikel in der Zeitschrift Inventions, online erschienen am 02.04.2026. Verfasst von Shafiqul Alam Khan und 3 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 64 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Firefighters must locate victims reliably to carry out rescue operations within burning structures during urban firefighting events. Low visibility, reduced oxygen levels, weakened structural rigidity, and dense smoke make it difficult to locate victims. In addition to these challenges, victims may be unconscious and unable to report their locations to firefighters. This research work explores the Double Deep Q-Network (Double DQN), Dueling Deep Q-Network (Dueling DQN), and Dueling Double Deep Q-Network (D3QN) agents for an unmanned aerial vehicle (UAV) to navigate around a structure and locate trapped victims within it. The UAV’s position, Light Detection and Ranging (LiDAR), and infrared camera data are utilized as inputs for the Deep Q-Networks. The PER is used to store transitions and sample them according to priority for training. Python’s Pygame library is used in this research to create a simulated environment in which infrared camera and LiDAR data are simulated. The performance of the UAV agent is evaluated using cumulative maximum reward, reward distribution histogram, Temporal Difference (TD) error over time, and number of successful episodes. Among the three DQN UAV agents, the Dueling DQN and Double DQN have potential for real-world applications in firefighting.
Zitieren
APA
Khan, S. A., Valles, D., Carvalho, M. M., & Dong, W. (2026). Conquering the Urban Firefighting Challenge: A Deep Q-Network Approach for Autonomous UAV Navigation. Inventions, 11(2), 35. https://doi.org/10.3390/inventions11020035
Vancouver
Khan SA, Valles D, Carvalho MM, Dong W. Conquering the Urban Firefighting Challenge: A Deep Q-Network Approach for Autonomous UAV Navigation. Inventions. 2026;11(2):35. doi:10.3390/inventions11020035
BibTeX
@article{Khan2026,
author = {Khan, Shafiqul Alam and Valles, Damian and Carvalho, Marcelo M. and Dong, Wenquan},
title = {Conquering the Urban Firefighting Challenge: A Deep Q-Network Approach for Autonomous UAV Navigation},
journal = {Inventions},
year = {2026},
volume = {11},
number = {2},
pages = {35},
doi = {10.3390/inventions11020035}
}
EUVIMED