EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

ActivAsk: Free-Energy-Guided Clarification for Robotic Grasping Under Ambiguous Instructions

Haoandong Yang, Gabriel W. Haddon-Hill, Teresa Zielinska, Shingo Murata

Robotics · 11.08.2026 · 15 (8) · 154

DOI: 10.3390/robotics15080154 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Robotics, online erschienen am 11.08.2026. Verfasst von Haoandong Yang und 3 weiteren Autor:innen. Die Arbeit nennt 48 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Japan Science and Technology Agency, Japan Society for the Promotion of Science, Kayamori Foundation of Informational Science Advancement.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Service robots often receive natural language instructions in changing workspaces where multiple visible objects may match one description. Relying on detector confidence, random selection, or direct vision–language model (VLM) prediction can lead to a wrong action. This paper presents ActivAsk, a zero-shot framework for resolving referential ambiguity before robotic grasping. ActivAsk constructs open-vocabulary candidates from red-green-blue-depth (RGB-D) input, asks candidate-grounded yes/no questions when needed, updates the candidate state from the user’s answer, and grasps after target resolution. It selects among VLM-proposed candidate partitions using an expected free energy (EFE) criterion motivated by active inference; with neutral response preferences, this reduces to information gain over candidate partitions. Offline experiments showed that interactive clarification improved target accuracy from about 53–54% for noninteractive baselines to about 90–92%. ActivAsk matched the best interactive accuracy (92.13%) while asking 15.47–19.71% fewer questions on asked trials and 21.43–23.88% fewer for ambiguous instructions. In online real robot experiments, ActivAsk achieved 92.98% target selection accuracy and 87.72% full correct object grasp success; unresolved or wrong targets were not physically executed after operator-controlled verification and were counted as task failures.

Förderung

  • Japan Science and Technology Agency
  • Japan Society for the Promotion of Science
  • Kayamori Foundation of Informational Science Advancement

Zitieren

APA

Yang, H., Haddon-Hill, G. W., Zielinska, T., & Murata, S. (2026). ActivAsk: Free-Energy-Guided Clarification for Robotic Grasping Under Ambiguous Instructions. Robotics, 15(8), 154. https://doi.org/10.3390/robotics15080154

Vancouver

Yang H, Haddon-Hill GW, Zielinska T, Murata S. ActivAsk: Free-Energy-Guided Clarification for Robotic Grasping Under Ambiguous Instructions. Robotics. 2026;15(8):154. doi:10.3390/robotics15080154

BibTeX
@article{Yang2026,
  author = {Yang, Haoandong and Haddon-Hill, Gabriel W. and Zielinska, Teresa and Murata, Shingo},
  title = {ActivAsk: Free-Energy-Guided Clarification for Robotic Grasping Under Ambiguous Instructions},
  journal = {Robotics},
  year = {2026},
  volume = {15},
  number = {8},
  pages = {154},
  doi = {10.3390/robotics15080154}
}
Kostenlos starten →