Semantic-Augmented Image Clustering via Adaptive Multi-Modal Collaboration
Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (33) · 28437-28445
DOI: 10.1609/aaai.v40i33.40073 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Xiaohan Zhang und 5 weiteren Autor:innen.
Abstract (Originalsprache)
Image clustering is a fundamental task in unsupervised visual learning. While recent self-supervised methods have explored various pretext tasks to generate supervision signals for clustering, they typically depend exclusively on raw images, resulting in insufficient supervision signals that are inherently constrained by limited visual semantics. In this paper, we propose a novel Semantic-Augmented image Clustering (SAC) method, which transcends the inherent limitations of purely visual representations through the integration of external knowledge. Specifically, SAC utilizes Vision-Language pre-trained Models (VLMs) to flexibly generate textual descriptions for each image, providing external semantic cues to supplement the visual information. By integrating both visual and textual information, SAC achieves image clustering through a multi-modal learning framework. To mitigate the negative impact of inaccurate textual information, SAC designs an uncertainty-driven adaptive weighting mechanism that explores both intra-modal and inter-modal neighborhood structures, and incorporates the adaptive weights into intra-modal and inter-modal contrastive learning, which improves the robustness against noisy image-text correspondences. Experiments on several popular datasets demonstrate the superiority of SAC compared to state-of-the-art methods.
Zitieren
APA
Zhang, X., Zhang, C., Xu, D., YU, H., Chen, C., & Li, H. (2026). Semantic-Augmented Image Clustering via Adaptive Multi-Modal Collaboration. Proceedings of the AAAI Conference on Artificial Intelligence, 40(33), 28437-28445. https://doi.org/10.1609/aaai.v40i33.40073
Vancouver
Zhang X, Zhang C, Xu D, YU H, Chen C, Li H. Semantic-Augmented Image Clustering via Adaptive Multi-Modal Collaboration. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(33):28437-28445. doi:10.1609/aaai.v40i33.40073
BibTeX
@article{Zhang2026,
author = {Zhang, Xiaohan and Zhang, Chao and Xu, Deng and YU, Hong and Chen, Chunlin and Li, Huaxiong},
title = {Semantic-Augmented Image Clustering via Adaptive Multi-Modal Collaboration},
journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
year = {2026},
volume = {40},
number = {33},
pages = {28437--28445},
doi = {10.1609/aaai.v40i33.40073}
}
EUVIMED