EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Optimizing a Dynamic Vehicle Routing Problem with Deep Reinforcement Learning: Analyzing State-Space Components

Anna Konovalenko, Lars Magnus Hvattum

Logistics · 02.10.2024 · 8 (4) · 96

DOI: 10.3390/logistics8040096 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Logistics, online erschienen am 02.10.2024. Verfasst von Anna Konovalenko und 1 weiteren Autor:innen. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

The dynamic vehicle routing problem (DVRP) is a complex optimization problem that is crucial for applications such as last-mile delivery. Our goal is to develop an application that can make real-time decisions to maximize total performance while adapting to the dynamic nature of incoming orders. We formulate the DVRP as a vehicle routing problem where new customer requests arrive dynamically, requiring immediate acceptance or rejection decisions.

Methods

This study leverages reinforcement learning (RL), a machine learning paradigm that operates via feedback-driven decisions, to tackle the DVRP. We present a detailed RL formulation and systematically investigate the impacts of various state-space components on algorithm performance. Our approach involves incrementally modifying the state space, including analyzing the impacts of individual components, applying data transformation methods, and incorporating derived features.

Results

Our findings demonstrate that a carefully designed state space in the formulation of the DVRP significantly improves RL performance. Notably, incorporating derived features and selectively applying feature transformation enhanced the model’s decision-making capabilities. The combination of all enhancements led to a statistically significant improvement in the results compared with the basic state formulation.

Conclusions

This research provides insights into RL modeling for DVRPs, highlighting the importance of state-space design. The proposed approach offers a flexible framework that is applicable to various variants of the DVRP, with potential for validation using real-world data.

Zitieren

APA

Konovalenko, A., & Hvattum, L. M. (2024). Optimizing a Dynamic Vehicle Routing Problem with Deep Reinforcement Learning: Analyzing State-Space Components. Logistics, 8(4), 96. https://doi.org/10.3390/logistics8040096

Vancouver

Konovalenko A, Hvattum LM. Optimizing a Dynamic Vehicle Routing Problem with Deep Reinforcement Learning: Analyzing State-Space Components. Logistics. 2024;8(4):96. doi:10.3390/logistics8040096

BibTeX
@article{Konovalenko2024,
  author = {Konovalenko, Anna and Hvattum, Lars Magnus},
  title = {Optimizing a Dynamic Vehicle Routing Problem with Deep Reinforcement Learning: Analyzing State-Space Components},
  journal = {Logistics},
  year = {2024},
  volume = {8},
  number = {4},
  pages = {96},
  doi = {10.3390/logistics8040096}
}
Kostenlos starten →