EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Knowledge graph-enhanced multi-agent reinforcement learning for adaptive scheduling in smart manufacturing

Zhaojun Qin, Yuqian Lu

Journal of Intelligent Manufacturing · 2025-12 · 36 (8) · 5943-5966

DOI: 10.1007/s10845-024-02494-0 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Intelligent Manufacturing, online erschienen am 13.10.2024. Verfasst von Zhaojun Qin und 1 weiteren Autor:innen. Die Arbeit wurde bisher 38-mal zitiert (Crossref) und nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: University of Auckland.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Self-organizing manufacturing network has emerged as a viable solution for adaptive manufacturing control within the mass personalization paradigm. This approach involves three critical elements: system modeling and control architecture, interoperable communication, and adaptive manufacturing control. However, current research often separates interoperable communication from adaptive manufacturing control as isolated areas of study. To address this gap, this paper introduces Knowledge Graph-enhanced Multi-Agent Reinforcement Learning (MARL) method that integrates interoperable communication via Knowledge Graphs with adaptive manufacturing control through Reinforcement Learning. We hypothesize that implicit domain knowledge obtained from historical production job allocation records can guide each agent to learn more effective scheduling policies with accelerated learning rates. This is based on the premise that machine assignment preferences effectively could reduce the Reinforcement Learning search space. Specifically, we redesign machine agents with new observation, action, reward, and cooperation mechanisms considering the preference of machines, building upon our previous MARL base model. The scheduling policies are trained under extensive simulation experiments that consider manufacturing requirements. During the training process, our approach demonstrates improved training speed compared with individual Reinforcement Learning methods under the same training hyperparameters. The obtained scheduling policies generated by our Knowledge Graph-enhanced MARL also outperform both individual Reinforcement Learning methods and heuristic rules under dynamic manufacturing settings.

Förderung

  • University of Auckland

Zitieren

APA

Qin, Z., & Lu, Y. (2025). Knowledge graph-enhanced multi-agent reinforcement learning for adaptive scheduling in smart manufacturing. Journal of Intelligent Manufacturing, 36(8), 5943-5966. https://doi.org/10.1007/s10845-024-02494-0

Vancouver

Qin Z, Lu Y. Knowledge graph-enhanced multi-agent reinforcement learning for adaptive scheduling in smart manufacturing. Journal of Intelligent Manufacturing. 2025;36(8):5943-5966. doi:10.1007/s10845-024-02494-0

BibTeX
@article{Qin2025,
  author = {Qin, Zhaojun and Lu, Yuqian},
  title = {Knowledge graph-enhanced multi-agent reinforcement learning for adaptive scheduling in smart manufacturing},
  journal = {Journal of Intelligent Manufacturing},
  year = {2025},
  volume = {36},
  number = {8},
  pages = {5943--5966},
  doi = {10.1007/s10845-024-02494-0}
}
Kostenlos starten →