EUVIMEDOpdag EUVIMED
Crossref

Interactive Imitation Learning in Robotics: A Survey

Carlos Celemin, Rodrigo Pérez-Dattari, Eugenio Chisari, Giovanni Franzese, Leandro de Souza Rosa, Ravi Prakash, Zlatan Ajanović, Marta Ferraz, Abhinav Valada, Jens Kober

Foundations and Trends® in Robotics · 2022-11-22 · 10 (1-2) · 1-197

DOI: 10.1561/2300000072 ↗

At a glance

Journal article in Foundations and Trends® in Robotics, published online on 2022-11-22. Written by Carlos Celemin and 9 co-authors. Cited 63 times so far (Crossref); 298 references.

AbstractBibliografiske oplysningerCiteRelated studies

Abstract (original language)

Interactive Imitation Learning (IIL) is a branch of Imitation Learning (IL) where human feedback is provided intermittently during robot execution allowing an online improvement of the robot’s behavior. In recent years, IIL has increasingly started to carve out its own space as a promising data-driven alternative for solving complex robotic tasks. The advantages of IIL are twofold, 1) it is data-efficient, as the human feedback guides the robot directly towards an improved behavior (in contrast with Reinforcement Learning (RL), where behaviors must be discovered by trial and error), and 2) it is robust, as the distribution mismatch between the teacher and learner trajectories is minimized by providing feedback directly over the learner’s trajectories (as opposed to offline IL methods such as Behavioral Cloning). Nevertheless, despite the opportunities that IIL presents, its terminology, structure, and applicability are not clear nor unified in the literature, slowing down its development and, therefore, the research of innovative formulations and discoveries. In this work, we attempt to facilitate research in IIL and lower entry barriers for new practitioners by providing a survey of the field that unifies and structures it. In addition, we aim to raise awareness of its potential, what has been accomplished and what are still open research questions. We organize the most relevant works in IIL in terms of human-robot interaction (i.e., types of feedback), interfaces (i.e., means of providing feedback), learning (i.e., models learned from feedback and function approximators), user experience (i.e., human perception about the learning process), applications, and benchmarks. Furthermore, we analyze similarities and differences between IIL and RL, providing a discussion on how the concepts offline, online, off-policy and on-policy learning should be transferred to IIL from the RL literature. We particularly focus on robotic applications in the real world and discuss their implications, limitations, and promising future areas of research.

Cite

APA

Celemin, C., Pérez-Dattari, R., Chisari, E., Franzese, G., Rosa, L. D. S., Prakash, R., Ajanović, Z., Ferraz, M., Valada, A., & Kober, J. (2022). Interactive Imitation Learning in Robotics: A Survey. Foundations and Trends® in Robotics, 10(1-2), 1-197. https://doi.org/10.1561/2300000072

Vancouver

Celemin C, Pérez-Dattari R, Chisari E, Franzese G, Rosa LDS, Prakash R, et al. Interactive Imitation Learning in Robotics: A Survey. Foundations and Trends® in Robotics. 2022;10(1-2):1-197. doi:10.1561/2300000072

BibTeX
@article{Celemin2022,
  author = {Celemin, Carlos and Pérez-Dattari, Rodrigo and Chisari, Eugenio and Franzese, Giovanni and Rosa, Leandro de Souza and Prakash, Ravi and Ajanović, Zlatan and Ferraz, Marta and Valada, Abhinav and Kober, Jens},
  title = {Interactive Imitation Learning in Robotics: A Survey},
  journal = {Foundations and Trends® in Robotics},
  year = {2022},
  volume = {10},
  number = {1-2},
  pages = {1--197},
  doi = {10.1561/2300000072}
}
Start for free →