EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A deep reinforcement learning method for container drayage transportation considering customer pairs

Chao Huang, Yinan Cui, Xiaoyang Zhou, Boyang Qu, Li Yan, Hui Zhang

Journal of Computational Design and Engineering · 07.05.2026 · 13 (5) · 250-268

DOI: 10.1093/jcde/qwag047 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Computational Design and Engineering, online erschienen am 12.05.2026. Verfasst von Chao Huang und 5 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 75 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Leading talents of science and technology in the Central Plain of China, Key Research and development projects of Henan Province.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Container drayage transportation serves as a critical link in global supply chains, yet truck capacity constraints and the complex interplay of multi-customer requirements often compromise drayage efficiency. These factors collectively increase fuel consumption and operational costs, posing significant challenges for logistics optimization. To address these issues, this article investigates a container drayage problem with customer pairs, where each pickup node corresponds to a delivery node. The optimization aims to minimize the trucks’ total fuel consumption. A mixed-integer nonlinear programming model is formulated on a graph-based representation to capture the coupling between task dependencies and truck states. To reduce computational complexity, we linearize the model by introducing several auxiliary variables. Recognizing the exponential growth of solution space in large-scale scenarios, we propose a deep reinforcement learning (DRL) method that integrates a Markov decision process, policy gradient optimization, and an attention mechanism. The method features a sequential decision-making system with an enhanced attention mechanism, a carefully designed cumulative reward function, and tailored training strategies. Specifically, the encoder efficiently extracts task features from depot, pickup, and delivery nodes, while the decoder optimizes feature fusion to guide task selection. Importantly, the model explicitly incorporates symmetry between customer pairs in both the encoder and decoder, thereby improving solution quality. Extensive experiments validate that the mathematical model, solved via Gurobi, obtains optimal solutions for small-scale instances within 1900 seconds, while the proposed DRL method achieves the same optimal solutions within 2700 seconds. For medium- and large-scale instances, DRL outperforms Gurobi, simulated annealing, and large neighborhood search, consistently delivering superior solutions within acceptable computation time, demonstrating strong generalization and robustness. Ablation studies further confirm the individual contributions of the encoder, decoder, and training strategy, with the full model achieving the best performance. These results underscore the potential of DRL as an effective tool for sustainable container drayage optimization.

Förderung

  • National Natural Science Foundation of China
  • Leading talents of science and technology in the Central Plain of China
  • Key Research and development projects of Henan Province
  • Science and Technology Innovation talents of Colleges and Universities in Henan Province
  • Graduate Education Reform Project of Henan Province
  • Postgraduate Education Reform and Quality Improvement Project of Henan Province
  • Foundation Research Project of Henan Provincial Key Scientific Research Program in Higher Education Institutions
  • Frontier Exploration Projects of Longmen Laboratory

Zitieren

APA

Huang, C., Cui, Y., Zhou, X., Qu, B., Yan, L., & Zhang, H. (2026). A deep reinforcement learning method for container drayage transportation considering customer pairs. Journal of Computational Design and Engineering, 13(5), 250-268. https://doi.org/10.1093/jcde/qwag047

Vancouver

Huang C, Cui Y, Zhou X, Qu B, Yan L, Zhang H. A deep reinforcement learning method for container drayage transportation considering customer pairs. Journal of Computational Design and Engineering. 2026;13(5):250-268. doi:10.1093/jcde/qwag047

BibTeX
@article{Huang2026,
  author = {Huang, Chao and Cui, Yinan and Zhou, Xiaoyang and Qu, Boyang and Yan, Li and Zhang, Hui},
  title = {A deep reinforcement learning method for container drayage transportation considering customer pairs},
  journal = {Journal of Computational Design and Engineering},
  year = {2026},
  volume = {13},
  number = {5},
  pages = {250--268},
  doi = {10.1093/jcde/qwag047}
}
Kostenlos starten →