EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Reinforcement Learning With Timed Constraints for Robotics Motion Planning

Zhaoan Wang, Junchao Li, Mohammad Mahdi Dehghan Pir, Shaoping Xiao

Artificial Intelligence for Engineering · 2026

DOI: 10.1049/aie2.70021 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Artificial Intelligence for Engineering, 2026. Verfasst von Zhaoan Wang und 3 weiteren Autor:innen. Die Arbeit nennt 38 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Science Foundation, U.S. Department of Education.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Robotic systems operating in dynamic and uncertain environments increasingly require planners that satisfy complex task sequences whilst adhering to strict temporal constraints. Metric interval temporal logic (MITL) offers a formal and expressive framework for specifying such time‐bounded requirements; however, integrating MITL with reinforcement learning (RL) remains challenging due to stochastic dynamics and partial observability. This paper presents an unified automata‐based RL framework for synthesising policies in both Markov decision processes (MDPs) and partially observable Markov decision processes (POMDPs) under MITL specifications. MITL formulae are translated into timed limit‐deterministic generalised Büchi automata (Timed‐LDGBA) and synchronized with the underlying decision process to construct product timed models suitable for Q‐learning. A simple yet expressive reward structure enforces temporal correctness whilst allowing additional performance objectives. The approach is validated in three simulation studies: a grid‐world formulated as an MDP, a grid‐world formulated as a POMDP and an office‐like service‐robot scenario. Results demonstrate that the proposed framework consistently learns policies that satisfy strict time‐bounded requirements under stochastic transitions, scales to larger state spaces and remains effective in partially observable environments, highlighting its potential for reliable robotic planning in time‐critical and uncertain settings.

Förderung

  • National Science Foundation
  • U.S. Department of Education

Zitieren

APA

Wang, Z., Li, J., Pir, M. M. D., & Xiao, S. (2026). Reinforcement Learning With Timed Constraints for Robotics Motion Planning. Artificial Intelligence for Engineering. https://doi.org/10.1049/aie2.70021

Vancouver

Wang Z, Li J, Pir MMD, Xiao S. Reinforcement Learning With Timed Constraints for Robotics Motion Planning. Artificial Intelligence for Engineering. 2026. doi:10.1049/aie2.70021

BibTeX
@article{Wang2026,
  author = {Wang, Zhaoan and Li, Junchao and Pir, Mohammad Mahdi Dehghan and Xiao, Shaoping},
  title = {Reinforcement Learning With Timed Constraints for Robotics Motion Planning},
  journal = {Artificial Intelligence for Engineering},
  year = {2026},
  doi = {10.1049/aie2.70021}
}
Kostenlos starten →