EUVIMEDOpdag EUVIMED
Open access · CC BY 4.0

Genetic-Algorithm-Aided Deep Reinforcement Learning for Multi-Agent Drone Delivery

Farabi Ahmed Tarhan, Nazım Kemal Ure

Drones · 2024-02-20 · 8 (3) · 71

DOI: 10.3390/drones8030071 ↗

At a glance

Journal article in Drones, published online on 2024-02-20. Written by Farabi Ahmed Tarhan and 1 co-authors. Cited 12 times so far (Crossref); 62 references. The full text is freely available (open access, CC BY 4.0). Funded by: Bilimsel Araştırma Projeleri Birimi, İstanbul Teknik Üniversitesi.

AbstractBibliografiske oplysningerCiteRelated studies

Abstract (original language)

The popularity of commercial unmanned aerial vehicles has drawn great attention from the e-commerce industry due to their suitability for last-mile delivery. However, the organization of multiple aerial vehicles efficiently for delivery within limitations and uncertainties is still a problem. The main challenge of planning is scalability, since the planning space grows exponentially to the number of agents, and it is not efficient to let human-level supervisors structure the problem for large-scale settings. Algorithms based on Deep Q-Networks had unprecedented success in solving decision-making problems. Extension of these algorithms to multi-agent problems is limited due to scalability issues. This work proposes an approach that improves the performance of Deep Q-Networks on multi-agent delivery by drone problems by utilizing state decompositions for lowering the problem complexity, Curriculum Learning for handling the exploration complexity, and Genetic Algorithms for searching efficient packet-drone matching across the combinatorial solution space. The performance of the proposed method is shown in a multi-agent delivery by drone problem that has 10 agents and ≈1077 state–action pairs. Comparative simulation results are provided to demonstrate the merit of the proposed method. The proposed Genetic-Algorithm-aided multi-agent DRL outperformed the rest in terms of scalability and convergent behavior.

Funding

  • Bilimsel Araştırma Projeleri Birimi, İstanbul Teknik Üniversitesi

Cite

APA

Tarhan, F. A., & Ure, N. K. (2024). Genetic-Algorithm-Aided Deep Reinforcement Learning for Multi-Agent Drone Delivery. Drones, 8(3), 71. https://doi.org/10.3390/drones8030071

Vancouver

Tarhan FA, Ure NK. Genetic-Algorithm-Aided Deep Reinforcement Learning for Multi-Agent Drone Delivery. Drones. 2024;8(3):71. doi:10.3390/drones8030071

BibTeX
@article{Tarhan2024,
  author = {Tarhan, Farabi Ahmed and Ure, Nazım Kemal},
  title = {Genetic-Algorithm-Aided Deep Reinforcement Learning for Multi-Agent Drone Delivery},
  journal = {Drones},
  year = {2024},
  volume = {8},
  number = {3},
  pages = {71},
  doi = {10.3390/drones8030071}
}
Start for free →