EUVIMEDEUVIMED entdecken
Crossref

Towards Generalist Robot Learning from Internet Video: A Survey (Abstract Reprint)

Robert McCarthy, Daniel C.H. Tan, Dominik Schmidt, Fernando Acero, Nathan Herr, Yilun Du, Thomas G. Thuruthel, Zhibin Li

Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (47) · 39882-39882

DOI: 10.1609/aaai.v40i47.41397 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Robert McCarthy und 7 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Scaling deep learning to massive and diverse internet data has driven remarkable breakthroughs in domains such as video generation and natural language processing. Robot learning, however, has thus far failed to replicate this success and remains constrained by a scarcity of available data. Learning from Videos (LfV) methods aim to address this data bottleneck by augmenting traditional robot data with large-scale internet video. This video data provides foundational information regarding physical dynamics, behaviours, and tasks, and can be highly informative for general-purpose robots. This survey systematically examines the emerging field of LfV. We first outline essential concepts, including detailing fundamental LfV challenges such as distribution shift and missing action labels in video data. Next, we comprehensively review current methods for extracting knowledge from large-scale internet video, overcoming LfV challenges, and improving robot learning through video-informed training. The survey concludes with a critical discussion of future opportunities. Here, we emphasize the need for scalable foundation model approaches that can leverage the full range of available internet video and enhance the learning of robot policies and dynamics models. Overall, the survey aims to inform and catalyse future LfV research, driving progress towards general-purpose robots.

Zitieren

APA

McCarthy, R., Tan, D. C., Schmidt, D., Acero, F., Herr, N., Du, Y., Thuruthel, T. G., & Li, Z. (2026). Towards Generalist Robot Learning from Internet Video: A Survey (Abstract Reprint). Proceedings of the AAAI Conference on Artificial Intelligence, 40(47), 39882-39882. https://doi.org/10.1609/aaai.v40i47.41397

Vancouver

McCarthy R, Tan DC, Schmidt D, Acero F, Herr N, Du Y, et al. Towards Generalist Robot Learning from Internet Video: A Survey (Abstract Reprint). Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(47):39882-39882. doi:10.1609/aaai.v40i47.41397

BibTeX
@article{McCarthy2026,
  author = {McCarthy, Robert and Tan, Daniel C.H. and Schmidt, Dominik and Acero, Fernando and Herr, Nathan and Du, Yilun and Thuruthel, Thomas G. and Li, Zhibin},
  title = {Towards Generalist Robot Learning from Internet Video: A Survey (Abstract Reprint)},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2026},
  volume = {40},
  number = {47},
  pages = {39882--39882},
  doi = {10.1609/aaai.v40i47.41397}
}
Kostenlos starten →