EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Conquering the Urban Firefighting Challenge: A Deep Q-Network Approach for Autonomous UAV Navigation

Shafiqul Alam Khan, Damian Valles, Marcelo M. Carvalho, Wenquan Dong

Inventions · 02.04.2026 · 11 (2) · 35

DOI: 10.3390/inventions11020035 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Inventions, online erschienen am 02.04.2026. Verfasst von Shafiqul Alam Khan und 3 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 64 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Firefighters must locate victims reliably to carry out rescue operations within burning structures during urban firefighting events. Low visibility, reduced oxygen levels, weakened structural rigidity, and dense smoke make it difficult to locate victims. In addition to these challenges, victims may be unconscious and unable to report their locations to firefighters. This research work explores the Double Deep Q-Network (Double DQN), Dueling Deep Q-Network (Dueling DQN), and Dueling Double Deep Q-Network (D3QN) agents for an unmanned aerial vehicle (UAV) to navigate around a structure and locate trapped victims within it. The UAV’s position, Light Detection and Ranging (LiDAR), and infrared camera data are utilized as inputs for the Deep Q-Networks. The PER is used to store transitions and sample them according to priority for training. Python’s Pygame library is used in this research to create a simulated environment in which infrared camera and LiDAR data are simulated. The performance of the UAV agent is evaluated using cumulative maximum reward, reward distribution histogram, Temporal Difference (TD) error over time, and number of successful episodes. Among the three DQN UAV agents, the Dueling DQN and Double DQN have potential for real-world applications in firefighting.

Zitieren

APA

Khan, S. A., Valles, D., Carvalho, M. M., & Dong, W. (2026). Conquering the Urban Firefighting Challenge: A Deep Q-Network Approach for Autonomous UAV Navigation. Inventions, 11(2), 35. https://doi.org/10.3390/inventions11020035

Vancouver

Khan SA, Valles D, Carvalho MM, Dong W. Conquering the Urban Firefighting Challenge: A Deep Q-Network Approach for Autonomous UAV Navigation. Inventions. 2026;11(2):35. doi:10.3390/inventions11020035

BibTeX
@article{Khan2026,
  author = {Khan, Shafiqul Alam and Valles, Damian and Carvalho, Marcelo M. and Dong, Wenquan},
  title = {Conquering the Urban Firefighting Challenge: A Deep Q-Network Approach for Autonomous UAV Navigation},
  journal = {Inventions},
  year = {2026},
  volume = {11},
  number = {2},
  pages = {35},
  doi = {10.3390/inventions11020035}
}
Kostenlos starten →