Situated proactive task generation for embodied agents
C2 Science and Technology · 2026-10 · 1 (1) · 83-90
DOI: 10.26599/c2st.2026.9700006 ↗Kurz gefasst
Fachartikel in der Zeitschrift C2 Science and Technology, online erschienen am 23.10.2026. Verfasst von Haifeng Xu und 3 weiteren Autor:innen. Die Arbeit nennt 21 Literaturangaben.
Abstract (Originalsprache)
Embodied agents operating in everyday environments must go beyond explicit instruction following toward proactive assistance, in which they infer latent human needs from ongoing dialogue, ground these needs in the physical scene, and determine whether and how to act. However, existing vision-language-action systems are primarily designed for explicit task execution and struggle to jointly reason over conversational context and dynamic embodied environments. In this work, we introduce HomeSPT-Bench, a benchmark for situated proactive task generation built on the OmniGibson simulator, in which agents must infer implicit needs from multi-party dialogue, ground them in fully specified 3D scenes, and decide on appropriate actions. Evaluations show that state-of-the-art VLM-based agents exhibit a substantial performance gap in this setting, with frequent failures in spatial grounding, occlusion handling, and intervention decision-making. HomeSPT-Bench provides a testbed for studying situated proactive behavior that integrates dialogue understanding with embodied scene grounding, and highlights the remaining gap between language-based reasoning and reliable embodied proactive assistance.
Zitieren
APA
Xu, H., Li, C., Yuan, X., & Liu, H. (2026). Situated proactive task generation for embodied agents. C2 Science and Technology, 1(1), 83-90. https://doi.org/10.26599/c2st.2026.9700006
Vancouver
Xu H, Li C, Yuan X, Liu H. Situated proactive task generation for embodied agents. C2 Science and Technology. 2026;1(1):83-90. doi:10.26599/c2st.2026.9700006
BibTeX
@article{Xu2026,
author = {Xu, Haifeng and Li, Chunwen and Yuan, Xiaohu and Liu, Huaping},
title = {Situated proactive task generation for embodied agents},
journal = {C2 Science and Technology},
year = {2026},
volume = {1},
number = {1},
pages = {83--90},
doi = {10.26599/c2st.2026.9700006}
}
EUVIMED