EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Quality Assessment of Light Field Images Based on Adaptive Attention in ViT

Yifan Du, Wei Lang, Xinwen Hu, Li Yu, Hua Zhang, Lingjun Zhang, Yifan Wu

Electronics · 29.07.2024 · 13 (15) · 2985

DOI: 10.3390/electronics13152985 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Electronics, online erschienen am 29.07.2024. Verfasst von Yifan Du und 6 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Key R&D Program of Zhejiang.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Light field images can record multiple information about the light rays in a scene and provide multiple views from a single image, offering a new data source for 3D reconstruction. However, ensuring the quality of light field images themselves is challenging, and distorted image inputs may lead to poor reconstruction results. Accurate light field image quality assessment can pre-judge the quality of light field images used as input for 3D reconstruction, providing a reference for the reconstruction results before the reconstruction work, significantly improving the efficiency of 3D reconstruction based on light field images. In this paper, we propose an Adaptive Vision Transformer-based light-field image-quality assessment model (AViT-LFIQA). The model adopts a multi-view sub-aperture image sequence input method, greatly reducing the number of input images while retaining as much information as possible from the original light field image, alleviating the training pressure on the neural network. Furthermore, we design an adaptive learnable attention layer based on ViT, which addresses the lack of inductive bias in ViT by using adaptive diagonal masking and a learnable temperature coefficient strategy, making the model more suitable for training on small datasets of light field images. Experimental results demonstrate that the proposed model is effective for various types of distortions and shows superior performance in light-field image-quality assessment.

Förderung

  • Key R&D Program of Zhejiang

Zitieren

APA

Du, Y., Lang, W., Hu, X., Yu, L., Zhang, H., Zhang, L., & Wu, Y. (2024). Quality Assessment of Light Field Images Based on Adaptive Attention in ViT. Electronics, 13(15), 2985. https://doi.org/10.3390/electronics13152985

Vancouver

Du Y, Lang W, Hu X, Yu L, Zhang H, Zhang L, et al. Quality Assessment of Light Field Images Based on Adaptive Attention in ViT. Electronics. 2024;13(15):2985. doi:10.3390/electronics13152985

BibTeX
@article{Du2024,
  author = {Du, Yifan and Lang, Wei and Hu, Xinwen and Yu, Li and Zhang, Hua and Zhang, Lingjun and Wu, Yifan},
  title = {Quality Assessment of Light Field Images Based on Adaptive Attention in ViT},
  journal = {Electronics},
  year = {2024},
  volume = {13},
  number = {15},
  pages = {2985},
  doi = {10.3390/electronics13152985}
}
Kostenlos starten →