EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Fine-Grained Vision-Language Method with Prompt Tuning for Blind Image Quality Assessment

Kai Tan, Wang Luo, Yaqing Chen, Xin He, Yumei Zhang, Mengqiang Li, Haoyu Wang

Information · 24.03.2026 · 17 (4) · 316

DOI: 10.3390/info17040316 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Information, online erschienen am 24.03.2026. Verfasst von Kai Tan und 6 weiteren Autor:innen. Die Arbeit nennt 48 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Fundamental Research Funds for the Safety Special Project of the Civil Aviation Administration of China (CAAC) https://ror.org/05gfwht30, Sichuan Science and Technology Program, Fundamental Research Funds for the Central Universities.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Blind image quality assessment (BIQA) without reference images remains significantly challenging due to the fact that perceptual quality is largely determined by subtle, spatially localized distortions. However, existing Contrastive Language–Image Pre-training (CLIP)-based methods exhibit limited sensitivity to fine-grained degradations such as local blur, noise, compression artifacts, and exposure inconsistencies, since they are optimized for global semantic alignment. To overcome these limitations, we propose a fine-grained vision–language framework that enhances distortion-aware representation by considering both fine-grained visual and detailed textual domains. Specially, our method employs a fine-grained CLIP architecture in conjunction with explicit textual descriptions to enable the effective identification of subtle regional degradations. Furthermore, a parameter-efficient prompt-tuning strategy is utilized to facilitate the learning of task-adaptive prompt representations tailored to image quality assessment (IQA). Extensive experiments on three widely used in-the-wild IQA benchmarks show that the proposed method achieves strong consistency with human subjective judgments: our training-free FGCLIP-IQA reaches a maximum SROCC of 0.732 on KonIQ-10k, outperforming the vanilla CLIP-IQA baseline, while the prompt-tuned FGCLIP-IQA+ further achieves a maximum SROCC of 0.909 on KonIQ-10k with only a small number of learnable parameters and exhibits robust cross-dataset generalization capabilities. These results demonstrate that the fine-grained vision–language alignment shows great potential for future development, and provides an efficient and accurate solution for the BIQA task.

Förderung

  • Fundamental Research Funds for the Safety Special Project of the Civil Aviation Administration of China (CAAC) https://ror.org/05gfwht30
  • Sichuan Science and Technology Program
  • Fundamental Research Funds for the Central Universities
  • Sichuan Flight Engineering Technology Research Center Foundation

Zitieren

APA

Tan, K., Luo, W., Chen, Y., He, X., Zhang, Y., Li, M., & Wang, H. (2026). Fine-Grained Vision-Language Method with Prompt Tuning for Blind Image Quality Assessment. Information, 17(4), 316. https://doi.org/10.3390/info17040316

Vancouver

Tan K, Luo W, Chen Y, He X, Zhang Y, Li M, et al. Fine-Grained Vision-Language Method with Prompt Tuning for Blind Image Quality Assessment. Information. 2026;17(4):316. doi:10.3390/info17040316

BibTeX
@article{Tan2026,
  author = {Tan, Kai and Luo, Wang and Chen, Yaqing and He, Xin and Zhang, Yumei and Li, Mengqiang and Wang, Haoyu},
  title = {Fine-Grained Vision-Language Method with Prompt Tuning for Blind Image Quality Assessment},
  journal = {Information},
  year = {2026},
  volume = {17},
  number = {4},
  pages = {316},
  doi = {10.3390/info17040316}
}
Kostenlos starten →