EUVIMEDEUVIMED entdecken
Crossref

Interactive Imitation Learning in Robotics: A Survey

Carlos Celemin, Rodrigo Pérez-Dattari, Eugenio Chisari, Giovanni Franzese, Leandro de Souza Rosa, Ravi Prakash, Zlatan Ajanović, Marta Ferraz, Abhinav Valada, Jens Kober

Foundations and Trends® in Robotics · 22.11.2022 · 10 (1-2) · 1-197

DOI: 10.1561/2300000072 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Foundations and Trends® in Robotics, online erschienen am 22.11.2022. Verfasst von Carlos Celemin und 9 weiteren Autor:innen. Die Arbeit wurde bisher 63-mal zitiert (Crossref) und nennt 298 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Interactive Imitation Learning (IIL) is a branch of Imitation Learning (IL) where human feedback is provided intermittently during robot execution allowing an online improvement of the robot’s behavior. In recent years, IIL has increasingly started to carve out its own space as a promising data-driven alternative for solving complex robotic tasks. The advantages of IIL are twofold, 1) it is data-efficient, as the human feedback guides the robot directly towards an improved behavior (in contrast with Reinforcement Learning (RL), where behaviors must be discovered by trial and error), and 2) it is robust, as the distribution mismatch between the teacher and learner trajectories is minimized by providing feedback directly over the learner’s trajectories (as opposed to offline IL methods such as Behavioral Cloning). Nevertheless, despite the opportunities that IIL presents, its terminology, structure, and applicability are not clear nor unified in the literature, slowing down its development and, therefore, the research of innovative formulations and discoveries. In this work, we attempt to facilitate research in IIL and lower entry barriers for new practitioners by providing a survey of the field that unifies and structures it. In addition, we aim to raise awareness of its potential, what has been accomplished and what are still open research questions. We organize the most relevant works in IIL in terms of human-robot interaction (i.e., types of feedback), interfaces (i.e., means of providing feedback), learning (i.e., models learned from feedback and function approximators), user experience (i.e., human perception about the learning process), applications, and benchmarks. Furthermore, we analyze similarities and differences between IIL and RL, providing a discussion on how the concepts offline, online, off-policy and on-policy learning should be transferred to IIL from the RL literature. We particularly focus on robotic applications in the real world and discuss their implications, limitations, and promising future areas of research.

Zitieren

APA

Celemin, C., Pérez-Dattari, R., Chisari, E., Franzese, G., Rosa, L. D. S., Prakash, R., Ajanović, Z., Ferraz, M., Valada, A., & Kober, J. (2022). Interactive Imitation Learning in Robotics: A Survey. Foundations and Trends® in Robotics, 10(1-2), 1-197. https://doi.org/10.1561/2300000072

Vancouver

Celemin C, Pérez-Dattari R, Chisari E, Franzese G, Rosa LDS, Prakash R, et al. Interactive Imitation Learning in Robotics: A Survey. Foundations and Trends® in Robotics. 2022;10(1-2):1-197. doi:10.1561/2300000072

BibTeX
@article{Celemin2022,
  author = {Celemin, Carlos and Pérez-Dattari, Rodrigo and Chisari, Eugenio and Franzese, Giovanni and Rosa, Leandro de Souza and Prakash, Ravi and Ajanović, Zlatan and Ferraz, Marta and Valada, Abhinav and Kober, Jens},
  title = {Interactive Imitation Learning in Robotics: A Survey},
  journal = {Foundations and Trends® in Robotics},
  year = {2022},
  volume = {10},
  number = {1-2},
  pages = {1--197},
  doi = {10.1561/2300000072}
}
Kostenlos starten →