EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

FOCUS: object-centric world models for robotic manipulation

Stefano Ferraro, Pietro Mazzaglia, Tim Verbelen, Bart Dhoedt

Frontiers in Neurorobotics · 30.04.2025 · 19

DOI: 10.3389/fnbot.2025.1585386 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Frontiers in Neurorobotics, online erschienen am 30.04.2025. Verfasst von Stefano Ferraro und 3 weiteren Autor:innen. Beteiligte Einrichtung: IDLab, Department of Information Technology, Ghent University-imec, Ghent, Belgium. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 66 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Understanding the world in terms of objects and the possible interactions with them is an important cognitive ability. However, current world models adopted in reinforcement learning typically lack this structure and represent the world state in a global latent vector. To address this, we propose FOCUS, a model-based agent that learns an object-centric world model. This novel representation also enables the design of an object-centric exploration mechanism, which encourages the agent to interact with objects and discover useful interactions. We benchmark FOCUS in several robotic manipulation settings, where we found that our method can be used to improve manipulation skills. The object-centric world model leads to more accurate predictions of the objects in the scene and it enables more efficient learning. The object-centric exploration strategy fosters interactions with the objects in the environment, such as reaching, moving, and rotating them, and it allows fast adaptation of the agent to sparse reward reinforcement learning tasks. Using a Franka Emika robot arm, we also showcase how FOCUS proves useful in real-world applications. Website: focus-manipulation.github.io .

Schlagwörter

Stichwörter der Autor:innen

embodied-AIneuro roboticsobject-centric explorationobject-centric representationworld models

Autor:innen und Institutionen

  • IDLab, Department of Information Technology, Ghent University-imec, Ghent, Belgium.
  • VERSES Research Lab, VERSES, Los Angeles, CA, United States.

Zitieren

APA

Ferraro, S., Mazzaglia, P., Verbelen, T., & Dhoedt, B. (2025). FOCUS: object-centric world models for robotic manipulation. Frontiers in Neurorobotics, 19. https://doi.org/10.3389/fnbot.2025.1585386

Vancouver

Ferraro S, Mazzaglia P, Verbelen T, Dhoedt B. FOCUS: object-centric world models for robotic manipulation. Frontiers in Neurorobotics. 2025;19. doi:10.3389/fnbot.2025.1585386

BibTeX
@article{Ferraro2025,
  author = {Ferraro, Stefano and Mazzaglia, Pietro and Verbelen, Tim and Dhoedt, Bart},
  title = {FOCUS: object-centric world models for robotic manipulation},
  journal = {Frontiers in Neurorobotics},
  year = {2025},
  volume = {19},
  doi = {10.3389/fnbot.2025.1585386}
}
Kostenlos starten →