Logic Unseen: Revealing the Logical Blindspots of Vision-Language Models
Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (34) · 29062-29070
DOI: 10.1609/aaai.v40i34.40143 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Yuchen Zhou und 8 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref).
Abstract (Originalsprache)
Vision-Language Models (VLMs), exemplified by CLIP, have emerged as foundational for multimodal intelligence. However, their capacity for logical understanding remains significantly underexplored, resulting in critical **''logical blindspots''** that limit their reliability in practical applications. To systematically diagnose this, we introduce **LogicBench**, a comprehensive benchmark with over 50,000 vision-language pairs across 9 logical categories and 4 diverse scenarios: images, videos, anomaly detection, and medical diagnostics. Our evaluation reveals that existing VLMs, even the state-of-the-art ones, fall at over 40 accuracy points below human performance, particularly in challenging tasks like Causality and Conditionality, highlighting their reliance on surface semantics over critical logical structures. To bridge this gap, we propose **LogicCLIP**, a novel training framework designed to boost VLMs' logical sensitivity through advancements in both data generation and optimization objectives. LogicCLIP utilizes logic-aware data generation and a contrastive learning strategy that combines coarse-grained alignment, a fine-grained multiple-choice objective, and a novel logical structure-aware objective. Extensive experiments demonstrate LogicCLIP's substantial improvements in logical comprehension across all LogicBench domains, significantly outperforming baselines. Moreover, LogicCLIP retains, and often surpasses, competitive performance on general vision-language benchmarks, demonstrating that the enhanced logical understanding does not come at the expense of general alignment. We believe LogicBench and LogicCLIP will be important resources for advancing VLM logical capabilities.
Zitieren
APA
Zhou, Y., Tang, J., Yang, S., Xiao, X., Dai, Y., Yang, W., Gou, C., Xia, X., & Chua, T. (2026). Logic Unseen: Revealing the Logical Blindspots of Vision-Language Models. Proceedings of the AAAI Conference on Artificial Intelligence, 40(34), 29062-29070. https://doi.org/10.1609/aaai.v40i34.40143
Vancouver
Zhou Y, Tang J, Yang S, Xiao X, Dai Y, Yang W, et al. Logic Unseen: Revealing the Logical Blindspots of Vision-Language Models. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(34):29062-29070. doi:10.1609/aaai.v40i34.40143
BibTeX
@article{Zhou2026,
author = {Zhou, Yuchen and Tang, Jiayu and Yang, Shuo and Xiao, Xiaoyan and Dai, Yuqin and Yang, Wenhao and Gou, Chao and Xia, Xiaobo and Chua, Tat-Seng},
title = {Logic Unseen: Revealing the Logical Blindspots of Vision-Language Models},
journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
year = {2026},
volume = {40},
number = {34},
pages = {29062--29070},
doi = {10.1609/aaai.v40i34.40143}
}
EUVIMED