EUVIMEDEUVIMED entdecken
Crossref

Exploiting Information Theory for Intuitive Robot Programming of Manual Activities

Elena Merlo, Marta Lagomarsino, Edoardo Lamon, Arash Ajoudani

IEEE Transactions on Robotics · 2025 · 41 · 1245-1262

DOI: 10.1109/tro.2025.3530267 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Robotics, 2025. Verfasst von Elena Merlo und 3 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 59 Literaturangaben. Gefördert von: European Union Horizon Project TORNADO, European Commission, NextGenerationEU.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Observational learning is a promising approach to enable people without expertise in programming to transfer skills to robots in a user-friendly manner, since it mirrors how humans learn new behaviors by observing others. Many existing methods focus on instructing robots to mimic human trajectories, but motion-level strategies often pose challenges in skills generalization across diverse environments. This article proposes a novel framework that allows robots to achieve a higher-level understanding of human-demonstrated manual tasks recorded in RGB videos. By recognizing the task structure and goals, robots generalize what observed to unseen scenarios. We found our task representation on Shannon's Information Theory (IT), which is applied for the first time to manual tasks. IT helps extract the active scene elements and quantify the information shared between hands and objects. We exploit scene graph properties to encode the extracted interaction features in a compact structure and segment the demonstration into blocks, streamlining the generation of behavior trees for robot replicas. Experiments validated the effectiveness of IT to automatically generate robot execution plans from a single human demonstration. In addition, we provide HANDSOME, an open-source dataset of HAND Skills demOnstrated by Multi-subjEcts, to promote further research and evaluation in this field.

Förderung

  • European Union Horizon Project TORNADO
  • European Commission
  • NextGenerationEU

Zitieren

APA

Merlo, E., Lagomarsino, M., Lamon, E., & Ajoudani, A. (2025). Exploiting Information Theory for Intuitive Robot Programming of Manual Activities. IEEE Transactions on Robotics, 41, 1245-1262. https://doi.org/10.1109/tro.2025.3530267

Vancouver

Merlo E, Lagomarsino M, Lamon E, Ajoudani A. Exploiting Information Theory for Intuitive Robot Programming of Manual Activities. IEEE Transactions on Robotics. 2025;41:1245-1262. doi:10.1109/tro.2025.3530267

BibTeX
@article{Merlo2025,
  author = {Merlo, Elena and Lagomarsino, Marta and Lamon, Edoardo and Ajoudani, Arash},
  title = {Exploiting Information Theory for Intuitive Robot Programming of Manual Activities},
  journal = {IEEE Transactions on Robotics},
  year = {2025},
  volume = {41},
  pages = {1245--1262},
  doi = {10.1109/tro.2025.3530267}
}
Kostenlos starten →