Optimizing a Dynamic Vehicle Routing Problem with Deep Reinforcement Learning: Analyzing State-Space Components
Logistics · 02.10.2024 · 8 (4) · 96
DOI: 10.3390/logistics8040096 ↗Kurz gefasst
Fachartikel in der Zeitschrift Logistics, online erschienen am 02.10.2024. Verfasst von Anna Konovalenko und 1 weiteren Autor:innen. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Background
The dynamic vehicle routing problem (DVRP) is a complex optimization problem that is crucial for applications such as last-mile delivery. Our goal is to develop an application that can make real-time decisions to maximize total performance while adapting to the dynamic nature of incoming orders. We formulate the DVRP as a vehicle routing problem where new customer requests arrive dynamically, requiring immediate acceptance or rejection decisions.
Methods
This study leverages reinforcement learning (RL), a machine learning paradigm that operates via feedback-driven decisions, to tackle the DVRP. We present a detailed RL formulation and systematically investigate the impacts of various state-space components on algorithm performance. Our approach involves incrementally modifying the state space, including analyzing the impacts of individual components, applying data transformation methods, and incorporating derived features.
Results
Our findings demonstrate that a carefully designed state space in the formulation of the DVRP significantly improves RL performance. Notably, incorporating derived features and selectively applying feature transformation enhanced the model’s decision-making capabilities. The combination of all enhancements led to a statistically significant improvement in the results compared with the basic state formulation.
Conclusions
This research provides insights into RL modeling for DVRPs, highlighting the importance of state-space design. The proposed approach offers a flexible framework that is applicable to various variants of the DVRP, with potential for validation using real-world data.
Zitieren
APA
Konovalenko, A., & Hvattum, L. M. (2024). Optimizing a Dynamic Vehicle Routing Problem with Deep Reinforcement Learning: Analyzing State-Space Components. Logistics, 8(4), 96. https://doi.org/10.3390/logistics8040096
Vancouver
Konovalenko A, Hvattum LM. Optimizing a Dynamic Vehicle Routing Problem with Deep Reinforcement Learning: Analyzing State-Space Components. Logistics. 2024;8(4):96. doi:10.3390/logistics8040096
BibTeX
@article{Konovalenko2024,
author = {Konovalenko, Anna and Hvattum, Lars Magnus},
title = {Optimizing a Dynamic Vehicle Routing Problem with Deep Reinforcement Learning: Analyzing State-Space Components},
journal = {Logistics},
year = {2024},
volume = {8},
number = {4},
pages = {96},
doi = {10.3390/logistics8040096}
}
EUVIMED