EUVIMEDEUVIMED entdecken
Crossref

Situated proactive task generation for embodied agents

Haifeng Xu, Chunwen Li, Xiaohu Yuan, Huaping Liu

C2 Science and Technology · 2026-10 · 1 (1) · 83-90

DOI: 10.26599/c2st.2026.9700006 ↗

Kurz gefasst

Fachartikel in der Zeitschrift C2 Science and Technology, online erschienen am 23.10.2026. Verfasst von Haifeng Xu und 3 weiteren Autor:innen. Die Arbeit nennt 21 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Embodied agents operating in everyday environments must go beyond explicit instruction following toward proactive assistance, in which they infer latent human needs from ongoing dialogue, ground these needs in the physical scene, and determine whether and how to act. However, existing vision-language-action systems are primarily designed for explicit task execution and struggle to jointly reason over conversational context and dynamic embodied environments. In this work, we introduce HomeSPT-Bench, a benchmark for situated proactive task generation built on the OmniGibson simulator, in which agents must infer implicit needs from multi-party dialogue, ground them in fully specified 3D scenes, and decide on appropriate actions. Evaluations show that state-of-the-art VLM-based agents exhibit a substantial performance gap in this setting, with frequent failures in spatial grounding, occlusion handling, and intervention decision-making. HomeSPT-Bench provides a testbed for studying situated proactive behavior that integrates dialogue understanding with embodied scene grounding, and highlights the remaining gap between language-based reasoning and reliable embodied proactive assistance.

Zitieren

APA

Xu, H., Li, C., Yuan, X., & Liu, H. (2026). Situated proactive task generation for embodied agents. C2 Science and Technology, 1(1), 83-90. https://doi.org/10.26599/c2st.2026.9700006

Vancouver

Xu H, Li C, Yuan X, Liu H. Situated proactive task generation for embodied agents. C2 Science and Technology. 2026;1(1):83-90. doi:10.26599/c2st.2026.9700006

BibTeX
@article{Xu2026,
  author = {Xu, Haifeng and Li, Chunwen and Yuan, Xiaohu and Liu, Huaping},
  title = {Situated proactive task generation for embodied agents},
  journal = {C2 Science and Technology},
  year = {2026},
  volume = {1},
  number = {1},
  pages = {83--90},
  doi = {10.26599/c2st.2026.9700006}
}
Kostenlos starten →