EUVIMEDEUVIMED entdecken
Crossref

What, Whether and How? Unveiling Process Reward Models for Thinking with Images Reasoning

Yujin Zhou, Pengcheng Wen, Jiale Chen, Boqin Yin, Han Zhu, Jiaming Ji, Juntao Dai, Chi-Min Chan, Sirui Han

Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (34) · 29071-29079

DOI: 10.1609/aaai.v40i34.40144 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Yujin Zhou und 8 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The rapid advancement of Large Vision Language Models (LVLMs) has demonstrated excellent abilities in various visual tasks. Building upon these developments, the thinking with images paradigm has emerged, enabling models to dynamically edit and re-encode visual information at each reasoning step, mirroring human visual processing. However, this paradigm introduces significant challenges as diverse errors may occur during reasoning processes. This necessitates Process Reward Models (PRMs) for distinguishing positive and negative reasoning steps, yet existing benchmarks for PRMs are predominantly text-centric and lack comprehensive assessment under this paradigm. To address these gaps, this work introduces the first comprehensive benchmark specifically designed for evaluating PRMs under the thinking with images paradigm. Our main contributions are: (1) Through extensive analysis of reasoning trajectories and guided search experiments with PRMs, we define 7 fine-grained error types and demonstrate both the necessity for specialized PRMs and the potential for improvement. (2) We construct a comprehensive benchmark comprising 1,206 manually annotated thinking with images reasoning trajectories spanning 4 categories and 16 subcategories for fine-grained evaluation of PRMs. (3) Our experimental analysis reveals that current LVLMs fall short as effective PRMs, exhibiting limited capabilities in visual reasoning process evaluation with significant performance disparities across error types, positive evaluation bias, and sensitivity to reasoning step positions. These findings demonstrate the effectiveness of our benchmark and establish crucial foundations for advancing PRMs in LVLMs.

Zitieren

APA

Zhou, Y., Wen, P., Chen, J., Yin, B., Zhu, H., Ji, J., Dai, J., Chan, C., & Han, S. (2026). What, Whether and How? Unveiling Process Reward Models for Thinking with Images Reasoning. Proceedings of the AAAI Conference on Artificial Intelligence, 40(34), 29071-29079. https://doi.org/10.1609/aaai.v40i34.40144

Vancouver

Zhou Y, Wen P, Chen J, Yin B, Zhu H, Ji J, et al. What, Whether and How? Unveiling Process Reward Models for Thinking with Images Reasoning. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(34):29071-29079. doi:10.1609/aaai.v40i34.40144

BibTeX
@article{Zhou2026,
  author = {Zhou, Yujin and Wen, Pengcheng and Chen, Jiale and Yin, Boqin and Zhu, Han and Ji, Jiaming and Dai, Juntao and Chan, Chi-Min and Han, Sirui},
  title = {What, Whether and How? Unveiling Process Reward Models for Thinking with Images Reasoning},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2026},
  volume = {40},
  number = {34},
  pages = {29071--29079},
  doi = {10.1609/aaai.v40i34.40144}
}
Kostenlos starten →