EUVIMEDEUVIMED entdecken
Crossref

Beyond Cosine Similarity: Magnitude-Aware CLIP for No-Reference Image Quality Assessment

Zhicheng Liao, Dongxu Wu, Zhenshan Shi, Sijie Mai, Hanwei Zhu, Lingyu Zhu, Yuncheng Jiang, Baoliang Chen

Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (9) · 6934-6942

DOI: 10.1609/aaai.v40i9.37627 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Zhicheng Liao und 7 weiteren Autor:innen. Die Arbeit wurde bisher 7-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Recent efforts have repurposed the Contrastive Language-Image Pre-training (CLIP) model for No-Reference Image Quality Assessment (NR-IQA) by measuring the cosine similarity between the image embedding and textual prompts such as "a good photo" or "a bad photo." However, this semantic similarity overlooks a critical yet underexplored cue: the magnitude of the CLIP image features, which we empirically find to exhibit a strong correlation with perceptual quality. In this work, we introduce a novel adaptive fusion framework that complements cosine similarity with a magnitude-aware quality cue. Specifically, we first extract the absolute CLIP image features and apply a Box-Cox transformation to statistically normalize the feature distribution and mitigate semantic sensitivity. The resulting scalar summary serves as a semantically-normalized auxiliary cue that complements cosine-based prompt matching. To integrate both cues effectively, we further design a confidence-guided fusion scheme that adaptively weighs each term according to its relative strength. Extensive experiments on multiple benchmark IQA datasets demonstrate that our method consistently outperforms standard CLIP-based IQA and state-of-the-art baselines, without any task-specific training.

Zitieren

APA

Liao, Z., Wu, D., Shi, Z., Mai, S., Zhu, H., Zhu, L., Jiang, Y., & Chen, B. (2026). Beyond Cosine Similarity: Magnitude-Aware CLIP for No-Reference Image Quality Assessment. Proceedings of the AAAI Conference on Artificial Intelligence, 40(9), 6934-6942. https://doi.org/10.1609/aaai.v40i9.37627

Vancouver

Liao Z, Wu D, Shi Z, Mai S, Zhu H, Zhu L, et al. Beyond Cosine Similarity: Magnitude-Aware CLIP for No-Reference Image Quality Assessment. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(9):6934-6942. doi:10.1609/aaai.v40i9.37627

BibTeX
@article{Liao2026,
  author = {Liao, Zhicheng and Wu, Dongxu and Shi, Zhenshan and Mai, Sijie and Zhu, Hanwei and Zhu, Lingyu and Jiang, Yuncheng and Chen, Baoliang},
  title = {Beyond Cosine Similarity: Magnitude-Aware CLIP for No-Reference Image Quality Assessment},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2026},
  volume = {40},
  number = {9},
  pages = {6934--6942},
  doi = {10.1609/aaai.v40i9.37627}
}
Kostenlos starten →