EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Estimation of Control Intervals for Reinforcement Learning-Based Manufacturing-Line Control

Chen-Wei Guo, Omar Ashour, Christian López, Conrad Tucker

Journal of Computing and Information Science in Engineering · 01.07.2026 · 26 (7)

DOI: 10.1115/1.4071110 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Computing and Information Science in Engineering, online erschienen am 29.04.2026. Verfasst von Chen-Wei Guo und 3 weiteren Autor:innen. Die Arbeit nennt 67 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Division of Research on Learning in Formal and Informal Settings.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Generative AI is reshaping manufacturing by generating designs, diagnosing bottlenecks, and optimizing complex systems, which includes controlling manufacturing lines. Efficient control of manufacturing lines requires coordinated decisions in routing, worker allocation, and scheduling. Although model-based approaches can yield optimal or near-optimal plans, they struggle to scale more complex systems. With advances in discrete-event simulation and AI-driven decision-making, generative decision models, such as reinforcement learning (RL), have emerged as alternatives for optimizing manufacturing systems. We show that a crucial design choice is the policy control interval. Because parts take time to propagate through stations and buffers in manufacturing systems, choosing this interval without analysis can result in suboptimal behavior and lower throughput. We introduce a layout-aware method for selecting the control interval in policy training. From the line layout, we estimate the distribution of end-to-end unit transit times and derive a control interval based on the distribution. Our results demonstrate that policy performance versus control interval is nonmonotonic with an interior optimum. Aligning the control interval with the dynamics of the manufacturing process yields gains up to 2.7× improvement in return and increased training stability relative to one-tick baselines, without modifying environments or algorithms. These results indicate that the control interval is a crucial factor the agent learning process. By aligning the control interval of policies with the way material flows, our method provides a plug-and-play procedure for a more robust RL in manufacturing control.

Förderung

  • Division of Research on Learning in Formal and Informal Settings

Zitieren

APA

Guo, C., Ashour, O., López, C., & Tucker, C. (2026). Estimation of Control Intervals for Reinforcement Learning-Based Manufacturing-Line Control. Journal of Computing and Information Science in Engineering, 26(7). https://doi.org/10.1115/1.4071110

Vancouver

Guo C, Ashour O, López C, Tucker C. Estimation of Control Intervals for Reinforcement Learning-Based Manufacturing-Line Control. Journal of Computing and Information Science in Engineering. 2026;26(7). doi:10.1115/1.4071110

BibTeX
@article{Guo2026,
  author = {Guo, Chen-Wei and Ashour, Omar and López, Christian and Tucker, Conrad},
  title = {Estimation of Control Intervals for Reinforcement Learning-Based Manufacturing-Line Control},
  journal = {Journal of Computing and Information Science in Engineering},
  year = {2026},
  volume = {26},
  number = {7},
  doi = {10.1115/1.4071110}
}
Kostenlos starten →