EUVIMEDEUVIMED entdecken
Crossref

Verb Mirage: Unveiling and Assessing Verb Concept Hallucinations in Multimodal Large Language Models

Zehao Wang, Xinpeng Liu, Yudonglin Zhang, Xiaoqian Wu, Zhou Fang, Yifan Fang, Junfu Pu, Cewu Lu, Yong-Lu Li

Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (12) · 10349-10357

DOI: 10.1609/aaai.v40i12.38005 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Zehao Wang und 8 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multimodal Large Language Models (MLLMs) have garnered significant attention recently and demonstrate outstanding capabilities in various tasks such as OCR, VQA, captioning, etc. However, hallucination remains a persistent issue. While numerous methods have been proposed to mitigate hallucinations, achieving notable improvements, these methods primarily focus on mitigating hallucinations related to object/noun concepts. Verb concepts, which are crucial for understanding human actions, have been largely overlooked. In this paper, to the best of our knowledge, we are the first to investigate the verb hallucination phenomenon of MLLMs from various perspectives. Our findings reveal that most state-of-the-art MLLMs suffer from severe verb hallucination. To assess the effectiveness of existing mitigation methods for object concept hallucination in relation to verb hallucination, we evaluated these methods and found that they do not effectively address verb hallucination. To address this issue, we propose a baseline method based on fine-tuning with rich verb knowledge, achieving decent superiority. The experiment results demonstrate that our method significantly reduces hallucinations related to verbs.

Zitieren

APA

Wang, Z., Liu, X., Zhang, Y., Wu, X., Fang, Z., Fang, Y., Pu, J., Lu, C., & Li, Y. (2026). Verb Mirage: Unveiling and Assessing Verb Concept Hallucinations in Multimodal Large Language Models. Proceedings of the AAAI Conference on Artificial Intelligence, 40(12), 10349-10357. https://doi.org/10.1609/aaai.v40i12.38005

Vancouver

Wang Z, Liu X, Zhang Y, Wu X, Fang Z, Fang Y, et al. Verb Mirage: Unveiling and Assessing Verb Concept Hallucinations in Multimodal Large Language Models. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(12):10349-10357. doi:10.1609/aaai.v40i12.38005

BibTeX
@article{Wang2026,
  author = {Wang, Zehao and Liu, Xinpeng and Zhang, Yudonglin and Wu, Xiaoqian and Fang, Zhou and Fang, Yifan and Pu, Junfu and Lu, Cewu and Li, Yong-Lu},
  title = {Verb Mirage: Unveiling and Assessing Verb Concept Hallucinations in Multimodal Large Language Models},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2026},
  volume = {40},
  number = {12},
  pages = {10349--10357},
  doi = {10.1609/aaai.v40i12.38005}
}
Kostenlos starten →