EUVIMEDEUVIMED entdecken
Crossref

Transformer-Based No-Reference Image Quality Assessment via Supervised Contrastive Learning

Jinsong Shi, Pan Gao, Jie Qin

Proceedings of the AAAI Conference on Artificial Intelligence · 24.03.2024 · 38 (5) · 4829-4837

DOI: 10.1609/aaai.v38i5.28285 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 24.03.2024. Verfasst von Jinsong Shi und 2 weiteren Autor:innen. Die Arbeit wurde bisher 50-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Image Quality Assessment (IQA) has long been a research hotspot in the field of image processing, especially No-Reference Image Quality Assessment (NR-IQA). Due to the powerful feature extraction ability, existing Convolution Neural Network (CNN) and Transformers based NR-IQA methods have achieved considerable progress. However, they still exhibit limited capability when facing unknown authentic distortion datasets. To further improve NR-IQA performance, in this paper, a novel supervised contrastive learning (SCL) and Transformer-based NR-IQA model SaTQA is proposed. We first train a model on a large-scale synthetic dataset by SCL (no image subjective score is required) to extract degradation features of images with various distortion types and levels. To further extract distortion information from images, we propose a backbone network incorporating the Multi-Stream Block (MSB) by combining the CNN inductive bias and Transformer long-term dependence modeling capability. Finally, we propose the Patch Attention Block (PAB) to obtain the final distorted image quality score by fusing the degradation features learned from contrastive learning with the perceptual distortion information extracted by the backbone network. Experimental results on six standard IQA datasets show that SaTQA outperforms the state-of-the-art methods for both synthetic and authentic datasets. Code is available at https://github.com/I2-Multimedia-Lab/SaTQA.

Zitieren

APA

Shi, J., Gao, P., & Qin, J. (2024). Transformer-Based No-Reference Image Quality Assessment via Supervised Contrastive Learning. Proceedings of the AAAI Conference on Artificial Intelligence, 38(5), 4829-4837. https://doi.org/10.1609/aaai.v38i5.28285

Vancouver

Shi J, Gao P, Qin J. Transformer-Based No-Reference Image Quality Assessment via Supervised Contrastive Learning. Proceedings of the AAAI Conference on Artificial Intelligence. 2024;38(5):4829-4837. doi:10.1609/aaai.v38i5.28285

BibTeX
@article{Shi2024,
  author = {Shi, Jinsong and Gao, Pan and Qin, Jie},
  title = {Transformer-Based No-Reference Image Quality Assessment via Supervised Contrastive Learning},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2024},
  volume = {38},
  number = {5},
  pages = {4829--4837},
  doi = {10.1609/aaai.v38i5.28285}
}
Kostenlos starten →