No-Reference Image Quality Assessment Combining Swin-Transformer and Natural Scene Statistics
Sensors · 12.08.2024 · 24 (16) · 5221
DOI: 10.3390/s24165221 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 12.08.2024. Verfasst von Yuxuan Yang und 2 weiteren Autor:innen. Beteiligte Einrichtung: School of Microelectronics, Tianjin University, Tianjin 300072, China. Die Arbeit wurde bisher 21-mal zitiert (Crossref) und nennt 65 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Key Research and Development Program of China.
Abstract (Originalsprache)
No-reference image quality assessment aims to evaluate image quality based on human subjective perceptions. Current methods face challenges with insufficient ability to focus on global and local information simultaneously and information loss due to image resizing. To address these issues, we propose a model that combines Swin-Transformer and natural scene statistics. The model utilizes Swin-Transformer to extract multi-scale features and incorporates a feature enhancement module and deformable convolution to improve feature representation, adapting better to structural variations in images, apply dual-branch attention to focus on key areas, and align the assessment more closely with human visual perception. The Natural Scene Statistics compensates information loss caused by image resizing. Additionally, we use a normalized loss function to accelerate model convergence and enhance stability. We evaluate our model on six standard image quality assessment datasets (both synthetic and authentic), and show that our model achieves advanced results across multiple datasets. Compared to the advanced DACNN method, our model achieved Spearman rank correlation coefficients of 0.922 and 0.923 on the KADID and KonIQ datasets, respectively, representing improvements of 1.9% and 2.4% over this method. It demonstrated outstanding performance in handling both synthetic and authentic scenes.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Microelectronics, Tianjin University, Tianjin 300072, China.
- Institute of Sensors and Measurements, University of Applied Sciences Ruhr West, 45479 Mülheim an der Ruhr, Germany.
Förderung
- National Key Research and Development Program of China
Zitieren
APA
Yang, Y., Lei, Z., & Li, C. (2024). No-Reference Image Quality Assessment Combining Swin-Transformer and Natural Scene Statistics. Sensors, 24(16), 5221. https://doi.org/10.3390/s24165221
Vancouver
Yang Y, Lei Z, Li C. No-Reference Image Quality Assessment Combining Swin-Transformer and Natural Scene Statistics. Sensors. 2024;24(16):5221. doi:10.3390/s24165221
BibTeX
@article{Yang2024,
author = {Yang, Yuxuan and Lei, Zhichun and Li, Changlu},
title = {No-Reference Image Quality Assessment Combining Swin-Transformer and Natural Scene Statistics},
journal = {Sensors},
year = {2024},
volume = {24},
number = {16},
pages = {5221},
doi = {10.3390/s24165221}
}
EUVIMED