EUVIMEDObjevte EUVIMED
Open access · CC BY 4.0

Generalising Rescue Operations in Disaster Scenarios Using Drones: A Lifelong Reinforcement Learning Approach

Jiangshan Xu, Dimitris Panagopoulos, Adolfo Perrusquía, Weisi Guo, Antonios Tsourdos

Drones · 2025-06-03 · 9 (6) · 409

DOI: 10.3390/drones9060409 ↗

At a glance

Journal article in Drones, published online on 2025-06-03. Written by Jiangshan Xu and 4 co-authors. Cited 11 times so far (Crossref); 42 references. The full text is freely available (open access, CC BY 4.0).

AbstraktBibliografické údajeCiteRelated studies

Abstract (original language)

Search and rescue (SAR) operations in post-earthquake environments are hindered by unseen environment conditions and uncertain victim locations. While reinforcement learning (RL) has been used to enhance unmanned aerial vehicle (UAV) navigation in such scenarios, its limited generalisation to novel environments, such as post-disaster environments, remains a challenge. To deal with this issue, this paper proposes an RL-based framework that combines the principles of lifelong learning and eligibility traces. Here, the approach uses a shaping reward heuristic based on pre-training experiences obtained from similar environments to improve generalisation, and simultaneously, eligibility traces are used to accelerate convergence of the overall approach. The combined contributions allows the RL algorithm to adapt to new environments, whilst ensuring fast convergence, critical for rescue missions. Extensive simulation studies show that the proposed framework can improve the average reward return by 46% compared to baseline RL algorithms. Ablation studies are also conducted, which demonstrate a 23% improvement in the overall reward score in environments with different complexities and a 56% improvement in scenarios with varying numbers of trapped individuals.

Cite

APA

Xu, J., Panagopoulos, D., Perrusquía, A., Guo, W., & Tsourdos, A. (2025). Generalising Rescue Operations in Disaster Scenarios Using Drones: A Lifelong Reinforcement Learning Approach. Drones, 9(6), 409. https://doi.org/10.3390/drones9060409

Vancouver

Xu J, Panagopoulos D, Perrusquía A, Guo W, Tsourdos A. Generalising Rescue Operations in Disaster Scenarios Using Drones: A Lifelong Reinforcement Learning Approach. Drones. 2025;9(6):409. doi:10.3390/drones9060409

BibTeX
@article{Xu2025,
  author = {Xu, Jiangshan and Panagopoulos, Dimitris and Perrusquía, Adolfo and Guo, Weisi and Tsourdos, Antonios},
  title = {Generalising Rescue Operations in Disaster Scenarios Using Drones: A Lifelong Reinforcement Learning Approach},
  journal = {Drones},
  year = {2025},
  volume = {9},
  number = {6},
  pages = {409},
  doi = {10.3390/drones9060409}
}
Start for free →