EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Reactive optimal motion planning for a class of holonomic planar agents using reinforcement learning with provable guarantees

Panagiotis Rousseas, Charalampos Bechlioulis, Kostas Kyriakopoulos

Frontiers in Robotics and AI · 03.01.2024 · 10

DOI: 10.3389/frobt.2023.1255696 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Frontiers in Robotics and AI, online erschienen am 03.01.2024. Verfasst von Panagiotis Rousseas und 2 weiteren Autor:innen. Beteiligte Einrichtung: Control Systems Laboratory, School of Mechanical Engineering, National Technical University of Athens, Athens, Greece. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 60 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In control theory, reactive methods have been widely celebrated owing to their success in providing robust, provably convergent solutions to control problems. Even though such methods have long been formulated for motion planning, optimality has largely been left untreated through reactive means, with the community focusing on discrete/graph-based solutions. Although the latter exhibit certain advantages (completeness, complicated state-spaces), the recent rise in Reinforcement Learning (RL), provides novel ways to address the limitations of reactive methods. The goal of this paper is to treat the reactive optimal motion planning problem through an RL framework. A policy iteration RL scheme is formulated in a consistent manner with the control-theoretic results, thus utilizing the advantages of each approach in a complementary way; RL is employed to construct the optimal input without necessitating the solution of a hard, non-linear partial differential equation. Conversely, safety, convergence and policy improvement are guaranteed through control theoretic arguments. The proposed method is validated in simulated synthetic workspaces, and compared against reactive methods as well as a PRM and an RRT ⋆ approach. The proposed method outperforms or closely matches the latter methods, indicating the near global optimality of the former, while providing a solution for planning from anywhere within the workspace to the goal position.

Schlagwörter

Stichwörter der Autor:innen

nonlinear systems and controloptimal controloptimal motion planningpath planningreinforcement learning

Autor:innen und Institutionen

  • Control Systems Laboratory, School of Mechanical Engineering, National Technical University of Athens, Athens, Greece.
  • Division of Systems and Control, Department of Electrical and Computer Engineering, University of Patras, Patras, Greece.
  • Center of AI & Robotics (CAIR), New York University, Abu Dhabi, United Arab Emirates.

Zitieren

APA

Rousseas, P., Bechlioulis, C., & Kyriakopoulos, K. (2024). Reactive optimal motion planning for a class of holonomic planar agents using reinforcement learning with provable guarantees. Frontiers in Robotics and AI, 10. https://doi.org/10.3389/frobt.2023.1255696

Vancouver

Rousseas P, Bechlioulis C, Kyriakopoulos K. Reactive optimal motion planning for a class of holonomic planar agents using reinforcement learning with provable guarantees. Frontiers in Robotics and AI. 2024;10. doi:10.3389/frobt.2023.1255696

BibTeX
@article{Rousseas2024,
  author = {Rousseas, Panagiotis and Bechlioulis, Charalampos and Kyriakopoulos, Kostas},
  title = {Reactive optimal motion planning for a class of holonomic planar agents using reinforcement learning with provable guarantees},
  journal = {Frontiers in Robotics and AI},
  year = {2024},
  volume = {10},
  doi = {10.3389/frobt.2023.1255696}
}
Kostenlos starten →