Genetic-Algorithm-Aided Deep Reinforcement Learning for Multi-Agent Drone Delivery
Drones · 2024-02-20 · 8 (3) · 71
DOI: 10.3390/drones8030071 ↗At a glance
Journal article in Drones, published online on 2024-02-20. Written by Farabi Ahmed Tarhan and 1 co-authors. Cited 12 times so far (Crossref); 62 references. The full text is freely available (open access, CC BY 4.0). Funded by: Bilimsel Araştırma Projeleri Birimi, İstanbul Teknik Üniversitesi.
Abstract (original language)
The popularity of commercial unmanned aerial vehicles has drawn great attention from the e-commerce industry due to their suitability for last-mile delivery. However, the organization of multiple aerial vehicles efficiently for delivery within limitations and uncertainties is still a problem. The main challenge of planning is scalability, since the planning space grows exponentially to the number of agents, and it is not efficient to let human-level supervisors structure the problem for large-scale settings. Algorithms based on Deep Q-Networks had unprecedented success in solving decision-making problems. Extension of these algorithms to multi-agent problems is limited due to scalability issues. This work proposes an approach that improves the performance of Deep Q-Networks on multi-agent delivery by drone problems by utilizing state decompositions for lowering the problem complexity, Curriculum Learning for handling the exploration complexity, and Genetic Algorithms for searching efficient packet-drone matching across the combinatorial solution space. The performance of the proposed method is shown in a multi-agent delivery by drone problem that has 10 agents and ≈1077 state–action pairs. Comparative simulation results are provided to demonstrate the merit of the proposed method. The proposed Genetic-Algorithm-aided multi-agent DRL outperformed the rest in terms of scalability and convergent behavior.
Funding
- Bilimsel Araştırma Projeleri Birimi, İstanbul Teknik Üniversitesi
Cite
APA
Tarhan, F. A., & Ure, N. K. (2024). Genetic-Algorithm-Aided Deep Reinforcement Learning for Multi-Agent Drone Delivery. Drones, 8(3), 71. https://doi.org/10.3390/drones8030071
Vancouver
Tarhan FA, Ure NK. Genetic-Algorithm-Aided Deep Reinforcement Learning for Multi-Agent Drone Delivery. Drones. 2024;8(3):71. doi:10.3390/drones8030071
BibTeX
@article{Tarhan2024,
author = {Tarhan, Farabi Ahmed and Ure, Nazım Kemal},
title = {Genetic-Algorithm-Aided Deep Reinforcement Learning for Multi-Agent Drone Delivery},
journal = {Drones},
year = {2024},
volume = {8},
number = {3},
pages = {71},
doi = {10.3390/drones8030071}
}
EUVIMED