EUVIMEDOpdag EUVIMED
Open access · CC BY 4.0

Intelligent Scheduling Based on Reinforcement Learning Approaches: Applying Advanced Q-Learning and State–Action–Reward–State–Action Reinforcement Learning Models for the Optimisation of Job Shop Scheduling Problems

Atefeh Momenikorbekandi, Maysam Abbod

Electronics · 2023-11-23 · 12 (23) · 4752

DOI: 10.3390/electronics12234752 ↗

At a glance

Journal article in Electronics, published online on 2023-11-23. Written by Atefeh Momenikorbekandi and 1 co-authors. Cited 22 times so far (Crossref); 35 references. The full text is freely available (open access, CC BY 4.0). Funded by: Brunel University London.

AbstractBibliografiske oplysningerCiteRelated studies

Abstract (original language)

Flexible job shop scheduling problems (FJSPs) have attracted significant research interest because they can considerably increase production efficiency in terms of energy, cost and time; they are considered the main part of the manufacturing systems which frequently need to be resolved to manage the variations in production requirements. In this study, novel reinforcement learning (RL) models, including advanced Q-learning (QRL) and RL-based state–action–reward–state–action (SARSA) models, are proposed to enhance the scheduling performance of FJSPs, in order to reduce the total makespan. To more accurately depict the problem realities, two categories of simulated single-machine job shops and multi-machine job shops, as well as the scheduling of a furnace model, are used to compare the learning impact and performance of the novel RL models to other algorithms. FJSPs are challenging to resolve and are considered non-deterministic polynomial-time hardness (NP-hard) problems. Numerous algorithms have been used previously to solve FJSPs. However, because their key parameters cannot be effectively changed dynamically throughout the computation process, the effectiveness and quality of the solutions fail to meet production standards. Consequently, in this research, developed RL models are presented. The efficacy and benefits of the suggested SARSA method for solving FJSPs are shown by extensive computer testing and comparisons. As a result, this can be a competitive algorithm for FJSPs.

Funding

  • Brunel University London

Cite

APA

Momenikorbekandi, A., & Abbod, M. (2023). Intelligent Scheduling Based on Reinforcement Learning Approaches: Applying Advanced Q-Learning and State–Action–Reward–State–Action Reinforcement Learning Models for the Optimisation of Job Shop Scheduling Problems. Electronics, 12(23), 4752. https://doi.org/10.3390/electronics12234752

Vancouver

Momenikorbekandi A, Abbod M. Intelligent Scheduling Based on Reinforcement Learning Approaches: Applying Advanced Q-Learning and State–Action–Reward–State–Action Reinforcement Learning Models for the Optimisation of Job Shop Scheduling Problems. Electronics. 2023;12(23):4752. doi:10.3390/electronics12234752

BibTeX
@article{Momenikorbekandi2023,
  author = {Momenikorbekandi, Atefeh and Abbod, Maysam},
  title = {Intelligent Scheduling Based on Reinforcement Learning Approaches: Applying Advanced Q-Learning and State–Action–Reward–State–Action Reinforcement Learning Models for the Optimisation of Job Shop Scheduling Problems},
  journal = {Electronics},
  year = {2023},
  volume = {12},
  number = {23},
  pages = {4752},
  doi = {10.3390/electronics12234752}
}
Start for free →