EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Unified Learning from Demonstrations, Corrections, and Preferences during Physical Human–Robot Interaction

Shaunak A. Mehta, Dylan P. Losey

ACM Transactions on Human-Robot Interaction · 30.09.2024 · 13 (3) · 1-25

DOI: 10.1145/3623384 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Human-Robot Interaction, online erschienen am 26.08.2024. Verfasst von Shaunak A. Mehta und 1 weiteren Autor:innen. Die Arbeit wurde bisher 20-mal zitiert (Crossref) und nennt 50 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NSF.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Humans can leverage physical interaction to teach robot arms. This physical interaction takes multiple forms depending on the task, the user, and what the robot has learned so far. State-of-the-art approaches focus on learning from a single modality, or combine some interaction types. Some methods do so by assuming that the robot has prior information about the features of the task and the reward structure. By contrast, in this article, we introduce an algorithmic formalism that unites learning from demonstrations, corrections, and preferences. Our approach makes no assumptions about the tasks the human wants to teach the robot; instead, we learn a reward model from scratch by comparing the human’s input to nearby alternatives, i.e., trajectories close to the human’s feedback. We first derive a loss function that trains an ensemble of reward models to match the human’s demonstrations, corrections, and preferences. The type and order of feedback is up to the human teacher: We enable the robot to collect this feedback passively or actively. We then apply constrained optimization to convert our learned reward into a desired robot trajectory. Through simulations and a user study, we demonstrate that our proposed approach more accurately learns manipulation tasks from physical human interaction than existing baselines, particularly when the robot is faced with new or unexpected objectives. Videos of our user study are available at https://youtu.be/FSUJsTYvEKU .

Förderung

  • NSF

Zitieren

APA

Mehta, S. A., & Losey, D. P. (2024). Unified Learning from Demonstrations, Corrections, and Preferences during Physical Human–Robot Interaction. ACM Transactions on Human-Robot Interaction, 13(3), 1-25. https://doi.org/10.1145/3623384

Vancouver

Mehta SA, Losey DP. Unified Learning from Demonstrations, Corrections, and Preferences during Physical Human–Robot Interaction. ACM Transactions on Human-Robot Interaction. 2024;13(3):1-25. doi:10.1145/3623384

BibTeX
@article{Mehta2024,
  author = {Mehta, Shaunak A. and Losey, Dylan P.},
  title = {Unified Learning from Demonstrations, Corrections, and Preferences during Physical Human–Robot Interaction},
  journal = {ACM Transactions on Human-Robot Interaction},
  year = {2024},
  volume = {13},
  number = {3},
  pages = {1--25},
  doi = {10.1145/3623384}
}
Kostenlos starten →