EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Data-Efficient Reinforcement Learning for Variable Impedance Control

Akhil S. Anand, Rituraj Kaushik, Jan Tommy Gravdahl, Fares J. Abu-Dakka

IEEE Access · 2024 · 12 · 15631-15641

DOI: 10.1109/access.2024.3355311 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Access, 2024. Verfasst von Akhil S. Anand und 3 weiteren Autor:innen. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 46 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: “Dynamic Robot Interaction and Motion Compensation”, Research Council of Norway, Basque Government.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

One of the most crucial steps toward achieving human-like manipulation skills in robots is to incorporate compliance into the robot controller. Compliance not only makes the robot’s behaviour safe but also makes it more energy efficient. In this direction, the variable impedance control (VIC) approach provides a framework for a robot to adapt its compliance during execution by employing an adaptive impedance law. Nevertheless, autonomously adapting the compliance profile as demanded by the task remains a challenging problem to be solved in practice. In this work, we introduce a reinforcement learning (RL)-based approach called DEVILC (Data-Efficient Variable Impedance Learning Controller) to learn the variable impedance controller through real-world interaction of the robot. More concretely, we use a model-based RL approach in which, after every interaction, the robot iteratively learns a probabilistic model of its dynamics using the Gaussian process regression model. The model is then used to optimize a neural-network policy that modulates the robot’s impedance such that the long-term reward for the task is maximized. Thanks to the model-based RL framework, DEVILC allows a robot to learn the VIC policy with only a few interactions, making it practical for real-world applications. In simulations and experiments, we evaluate DEVILC on a Franka Emika Panda robotic manipulator for different manipulation tasks in the Cartesian space. The results show that DEVILC is a promising direction toward autonomously learning compliant manipulation skills directly in the real world through interactions. A video of the experiments is available in the link: https://youtu.be/_uyr0Vye5no.

Förderung

  • “Dynamic Robot Interaction and Motion Compensation”
  • Research Council of Norway
  • Basque Government

Zitieren

APA

Anand, A. S., Kaushik, R., Gravdahl, J. T., & Abu-Dakka, F. J. (2024). Data-Efficient Reinforcement Learning for Variable Impedance Control. IEEE Access, 12, 15631-15641. https://doi.org/10.1109/access.2024.3355311

Vancouver

Anand AS, Kaushik R, Gravdahl JT, Abu-Dakka FJ. Data-Efficient Reinforcement Learning for Variable Impedance Control. IEEE Access. 2024;12:15631-15641. doi:10.1109/access.2024.3355311

BibTeX
@article{Anand2024,
  author = {Anand, Akhil S. and Kaushik, Rituraj and Gravdahl, Jan Tommy and Abu-Dakka, Fares J.},
  title = {Data-Efficient Reinforcement Learning for Variable Impedance Control},
  journal = {IEEE Access},
  year = {2024},
  volume = {12},
  pages = {15631--15641},
  doi = {10.1109/access.2024.3355311}
}
Kostenlos starten →