EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

EgoPlan-Bench: Benchmarking Multimodal Large Language Models for Human-Level Planning

Yi Chen, Yuying Ge, Yixiao Ge, Mingyu Ding, Bohao Li, Rui Wang, Ruifeng Xu, Ying Shan, Xihui Liu

International Journal of Computer Vision · 2026-03 · 134 (3)

DOI: 10.1007/s11263-025-02676-0 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Computer Vision, online erschienen am 12.02.2026. Verfasst von Yi Chen und 8 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 85 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The pursuit of artificial general intelligence (AGI) has been accelerated by Multimodal Large Language Models (MLLMs), which exhibit superior reasoning, generalization capabilities, and proficiency in processing multimodal inputs. A crucial milestone in the evolution of AGI is the attainment of human-level planning, a fundamental ability for making informed decisions in complex environments, and solving a wide range of real-world problems. Despite the impressive advancements in MLLMs, a question remains: How far are current MLLMs from achieving human-level planning? To shed light on this question, we introduce EgoPlan-Bench, a comprehensive benchmark to evaluate the planning abilities of MLLMs in real-world scenarios from an egocentric perspective, mirroring human perception. EgoPlan-Bench emphasizes the evaluation of planning capabilities of MLLMs, featuring realistic tasks, diverse action plans, and intricate visual observations. Our rigorous evaluation of a wide range of MLLMs reveals that EgoPlan-Bench poses significant challenges, highlighting a substantial scope for improvement in MLLMs to achieve human-level task planning. To facilitate this advancement, we further present EgoPlan-IT, a specialized instruction-tuning dataset that effectively enhances model performance on EgoPlan-Bench. We have made all the codes, data, and a maintained benchmark leaderboard available at https://chenyi99.github.io/ego_plan/ to advance future research.

Zitieren

APA

Chen, Y., Ge, Y., Ge, Y., Ding, M., Li, B., Wang, R., Xu, R., Shan, Y., & Liu, X. (2026). EgoPlan-Bench: Benchmarking Multimodal Large Language Models for Human-Level Planning. International Journal of Computer Vision, 134(3). https://doi.org/10.1007/s11263-025-02676-0

Vancouver

Chen Y, Ge Y, Ge Y, Ding M, Li B, Wang R, et al. EgoPlan-Bench: Benchmarking Multimodal Large Language Models for Human-Level Planning. International Journal of Computer Vision. 2026;134(3). doi:10.1007/s11263-025-02676-0

BibTeX
@article{Chen2026,
  author = {Chen, Yi and Ge, Yuying and Ge, Yixiao and Ding, Mingyu and Li, Bohao and Wang, Rui and Xu, Ruifeng and Shan, Ying and Liu, Xihui},
  title = {EgoPlan-Bench: Benchmarking Multimodal Large Language Models for Human-Level Planning},
  journal = {International Journal of Computer Vision},
  year = {2026},
  volume = {134},
  number = {3},
  doi = {10.1007/s11263-025-02676-0}
}
Kostenlos starten →