Dynamic Job-Shop Scheduling Based on Transformer and Deep Reinforcement Learning
Processes · 15.12.2023 · 11 (12) · 3434
DOI: 10.3390/pr11123434 ↗Kurz gefasst
Fachartikel in der Zeitschrift Processes, online erschienen am 15.12.2023. Verfasst von Liyuan Song und 2 weiteren Autor:innen. Die Arbeit wurde bisher 37-mal zitiert (Crossref) und nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Key Research and Development Program of China.
Abstract (Originalsprache)
The dynamic job-shop scheduling problem is a complex and uncertain task that involves optimizing production planning and resource allocation in a dynamic production environment. Traditional methods are limited in effectively handling dynamic events and quickly generating scheduling solutions; in order to solve this problem, this paper proposes a solution by transforming the dynamic job-shop scheduling problem into a Markov decision process and leveraging deep reinforcement learning techniques. The proposed framework introduces several innovative components, which make full use of human domain knowledge and machine computing power, to realize the goal of man–machine collaborative decision-making. Firstly, we utilize disjunctive graphs as the state representation, capturing the complex relationships between various elements of the scheduling problem. Secondly, we select a set of dispatching rules through data envelopment analysis to form the action space, allowing for flexible and efficient scheduling decisions. Thirdly, the transformer model is employed as the feature extraction module, enabling effective capturing of state relationships and improving the representation power. Moreover, the framework incorporates the dueling double deep Q-network with prioritized experience replay, mapping each state to the most appropriate dispatching rule. Additionally, a dynamic target strategy with an elite mechanism is proposed. Through extensive experiments conducted on multiple examples, our proposed framework consistently outperformed traditional dispatching rules, genetic algorithms, and other reinforcement learning methods, achieving improvements of 15.98%, 17.98%, and 13.84%, respectively. These results validate the effectiveness and superiority of our approach in addressing dynamic job-shop scheduling problems.
Förderung
- National Key Research and Development Program of China
Zitieren
APA
Song, L., Li, Y., & Xu, J. (2023). Dynamic Job-Shop Scheduling Based on Transformer and Deep Reinforcement Learning. Processes, 11(12), 3434. https://doi.org/10.3390/pr11123434
Vancouver
Song L, Li Y, Xu J. Dynamic Job-Shop Scheduling Based on Transformer and Deep Reinforcement Learning. Processes. 2023;11(12):3434. doi:10.3390/pr11123434
BibTeX
@article{Song2023,
author = {Song, Liyuan and Li, Yuanyuan and Xu, Jiacheng},
title = {Dynamic Job-Shop Scheduling Based on Transformer and Deep Reinforcement Learning},
journal = {Processes},
year = {2023},
volume = {11},
number = {12},
pages = {3434},
doi = {10.3390/pr11123434}
}
EUVIMED