EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A transformer-based deep reinforcement learning approach for dynamic parallel machine scheduling problem with family setups

Funing Li, Sebastian Lang, Yuan Tian, Bingyuan Hong, Benjamin Rolf, Ruben Noortwyck, Robert Schulz, Tobias Reggelin

Journal of Intelligent Manufacturing · 2025-10 · 36 (7) · 4735-4768

DOI: 10.1007/s10845-024-02470-8 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Intelligent Manufacturing, online erschienen am 08.08.2024. Verfasst von Funing Li und 7 weiteren Autor:innen. Die Arbeit wurde bisher 23-mal zitiert (Crossref) und nennt 86 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Basic Public Welfare Research Program of Zhejiang Province, Zhoushan Science and Technology Project.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The parallel machine scheduling problem (PMSP) involves the optimized assignment of a set of jobs to a collection of parallel machines, which is a proper formulation for the modern manufacturing environment. Deep reinforcement learning (DRL) has been widely employed to solve PMSP. However, the majority of existing DRL-based frameworks still suffer from generalizability and scalability. More specifically, the state and action design still heavily rely on human efforts. To bridge these gaps, we propose a practical reinforcement learning-based framework to tackle a PMSP with new job arrivals and family setup constraints. We design a variable-length state matrix containing full job and machine information. This enables the DRL agent to autonomously extract features from raw data and make decisions with a global perspective. To efficiently process this novel state matrix, we elaborately modify a Transformer model to represent the DRL agent. By integrating the modified Transformer model to represent the DRL agent, a novel state representation can be effectively leveraged. This innovative DRL framework offers a high-quality and robust solution that significantly reduces the reliance on manual effort traditionally required in scheduling tasks. In the numerical experiment, the stability of the proposed agent during training is first demonstrated. Then we compare this trained agent on 192 instances with several existing approaches, namely a DRL-based approach, a metaheuristic algorithm, and a dispatching rule. The extensive experimental results demonstrate the scalability of our approach and its effectiveness across a variety of scheduling scenarios. Conclusively, our approach can thus solve the scheduling problems with high efficiency and flexibility, paving the way for application of DRL in solving complex and dynamic scheduling problems.

Förderung

  • Basic Public Welfare Research Program of Zhejiang Province
  • Zhoushan Science and Technology Project

Zitieren

APA

Li, F., Lang, S., Tian, Y., Hong, B., Rolf, B., Noortwyck, R., Schulz, R., & Reggelin, T. (2025). A transformer-based deep reinforcement learning approach for dynamic parallel machine scheduling problem with family setups. Journal of Intelligent Manufacturing, 36(7), 4735-4768. https://doi.org/10.1007/s10845-024-02470-8

Vancouver

Li F, Lang S, Tian Y, Hong B, Rolf B, Noortwyck R, et al. A transformer-based deep reinforcement learning approach for dynamic parallel machine scheduling problem with family setups. Journal of Intelligent Manufacturing. 2025;36(7):4735-4768. doi:10.1007/s10845-024-02470-8

BibTeX
@article{Li2025,
  author = {Li, Funing and Lang, Sebastian and Tian, Yuan and Hong, Bingyuan and Rolf, Benjamin and Noortwyck, Ruben and Schulz, Robert and Reggelin, Tobias},
  title = {A transformer-based deep reinforcement learning approach for dynamic parallel machine scheduling problem with family setups},
  journal = {Journal of Intelligent Manufacturing},
  year = {2025},
  volume = {36},
  number = {7},
  pages = {4735--4768},
  doi = {10.1007/s10845-024-02470-8}
}
Kostenlos starten →