Robot learning on the job: Human-in-the-loop autonomy and learning during deployment
The International Journal of Robotics Research · 2025-09 · 44 (10-11) · 1727-1742
DOI: 10.1177/02783649241273901 ↗Kurz gefasst
Fachartikel in der Zeitschrift The International Journal of Robotics Research, online erschienen am 23.10.2024. Verfasst von Huihan Liu und 4 weiteren Autor:innen. Die Arbeit wurde bisher 19-mal zitiert (Crossref) und nennt 70 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Science Foundation, Office of Naval Research, Amazon.
Abstract (Originalsprache)
With the rapid growth of computing powers and recent advances in deep learning, we have witnessed impressive demonstrations of novel robot capabilities in research settings. Nonetheless, these learning systems exhibit brittle generalization and require excessive training data for practical tasks. To harness the capabilities of state-of-the-art robot learning models while embracing their imperfections, we present Sirius, a principled framework for humans and robots to collaborate through a division of work. In this framework, partially autonomous robots are tasked with handling a major portion of decision-making where they work reliably; meanwhile, human operators monitor the process and intervene in challenging situations. Such a human–robot team ensures safe deployments in complex tasks. Further, we introduce a new learning algorithm to improve the policy’s performance on the data collected from the task executions. The core idea is re-weighing training samples with approximated human trust and optimizing the policies with weighted behavioral cloning. We evaluate Sirius in simulation and on real hardware, showing that Sirius consistently outperforms baselines over a collection of contact-rich manipulation tasks, achieving an 8% boost in simulation and 27% on real hardware than the state-of-the-art methods in policy success rate, with twice faster convergence and 85% memory size reduction. Videos and more details are available at https://ut-austin-rpl.github.io/sirius/ .
Förderung
- National Science Foundation
- Office of Naval Research
- Amazon
Zitieren
APA
Liu, H., Nasiriany, S., Zhang, L., Bao, Z., & Zhu, Y. (2025). Robot learning on the job: Human-in-the-loop autonomy and learning during deployment. The International Journal of Robotics Research, 44(10-11), 1727-1742. https://doi.org/10.1177/02783649241273901
Vancouver
Liu H, Nasiriany S, Zhang L, Bao Z, Zhu Y. Robot learning on the job: Human-in-the-loop autonomy and learning during deployment. The International Journal of Robotics Research. 2025;44(10-11):1727-1742. doi:10.1177/02783649241273901
BibTeX
@article{Liu2025,
author = {Liu, Huihan and Nasiriany, Soroush and Zhang, Lance and Bao, Zhiyao and Zhu, Yuke},
title = {Robot learning on the job: Human-in-the-loop autonomy and learning during deployment},
journal = {The International Journal of Robotics Research},
year = {2025},
volume = {44},
number = {10-11},
pages = {1727--1742},
doi = {10.1177/02783649241273901}
}
EUVIMED