EUVIMEDEUVIMED entdecken
Crossref

An Algorithmic Perspective on Imitation Learning

Takayuki Osa, Joni Pajarinen, Gerhard Neumann, J. Andrew Bagnell, Pieter Abbeel, Jan Peters

Foundations and Trends® in Robotics · 27.03.2018 · 7 (1-2) · 1-179

DOI: 10.1561/2300000053 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Foundations and Trends® in Robotics, online erschienen am 27.03.2018. Verfasst von Takayuki Osa und 5 weiteren Autor:innen. Die Arbeit wurde bisher 339-mal zitiert (Crossref) und nennt 240 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

As robots and other intelligent agents move from simple environments and problems to more complex, unstructured settings, manually programming their behavior has become increasingly challenging and expensive. Often, it is easier for a teacher to demonstrate a desired behavior rather than attempt to manually engineer it. This process of learning from demonstrations, and the study of algorithms to do so, is called imitation learning. This work provides an introduction to imitation learning. It covers the underlying assumptions, approaches, and how they relate; the rich set of algorithms developed to tackle the problem; and advice on effective tools and implementation. We intend this paper to serve two audiences. First, we want to familiarize machine learning experts with the challenges of imitation learning, particularly those arising in robotics, and the interesting theoretical and practical distinctions between it and more familiar frameworks like statistical supervised learning theory and reinforcement learning. Second, we want to give roboticists and experts in applied artificial intelligence a broader appreciation for the frameworks and tools available for imitation learning. We organize our work by dividing imitation learning into directly replicating desired behavior (sometimes called behavioral cloning [Bain and Sammut, 1996]) and learning the hidden objectives of the desired behavior from demonstrations (called inverse optimal control [Kalman, 1964] or inverse reinforcement learning [Russell, 1998]). In addition to method analysis, we discuss the design decisions a practitioner must make when selecting an imitation learning approach. Moreover, application examples—such as robots that play table tennis Kober and Peters, 2009 and programs that play the game of Go Silver et al. 2016—illustrate the properties and motivations behind different forms of imitation learning. We conclude by presenting a set of open questions and point towards possible future research directions.

Zitieren

APA

Osa, T., Pajarinen, J., Neumann, G., Bagnell, J. A., Abbeel, P., & Peters, J. (2018). An Algorithmic Perspective on Imitation Learning. Foundations and Trends® in Robotics, 7(1-2), 1-179. https://doi.org/10.1561/2300000053

Vancouver

Osa T, Pajarinen J, Neumann G, Bagnell JA, Abbeel P, Peters J. An Algorithmic Perspective on Imitation Learning. Foundations and Trends® in Robotics. 2018;7(1-2):1-179. doi:10.1561/2300000053

BibTeX
@article{Osa2018,
  author = {Osa, Takayuki and Pajarinen, Joni and Neumann, Gerhard and Bagnell, J. Andrew and Abbeel, Pieter and Peters, Jan},
  title = {An Algorithmic Perspective on Imitation Learning},
  journal = {Foundations and Trends® in Robotics},
  year = {2018},
  volume = {7},
  number = {1-2},
  pages = {1--179},
  doi = {10.1561/2300000053}
}
Kostenlos starten →