Bidirectional Feature Aggregation Network for Stereo Image Quality Assessment Considering Parallax Attention-Based Binocular Fusion
IEEE Transactions on Broadcasting · 2024-03 · 70 (1) · 278-289
DOI: 10.1109/tbc.2023.3278096 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Broadcasting, 2024-03. Verfasst von Yongli Chang und 5 weiteren Autor:innen. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 55 Literaturangaben. Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
Inspired by the two-path visual information processing mechanism (i.e., a bottom-up path and a top-down path), we propose a bidirectional binocular feature aggregation based stereo image quality assessment (SIQA) network, which considers a two-path visual mechanism and realizes the binocular fusion based on parallax information. To better aggregate binocular features from different levels, a two-path feature aggregation structure, which simulates the bottom-up and top-down mechanism in human visual system (HVS), is proposed. It not only realizes the supplement of low-level detail information to high-level semantic in the bottom-up path, but also realizes the supplement of high-level semantic information to low-level detail in the top-down path. Simultaneously, because feature misalignment exists in binocular features of adjacent levels, a feature alignment module (FAM) based on deformable convolution is designed to integrate the binocular fusion features of adjacent levels. In addition, considering the importance role of parallax in guiding binocular fusion, a binocular fusion module (BFM) based on parallax attention mechanism, which is different with existing binocular fusion methods, is explicitly proposed to achieve the binocular fusion between the left and right view features. Extensive experiments are conducted on LIVE I, LIVE II, WIVC I and WIVC II databases to demonstrate the effectiveness of the proposed method.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Chang, Y., Li, S., Liu, A., Zhang, W., Jin, J., & Xiang, W. (2024). Bidirectional Feature Aggregation Network for Stereo Image Quality Assessment Considering Parallax Attention-Based Binocular Fusion. IEEE Transactions on Broadcasting, 70(1), 278-289. https://doi.org/10.1109/tbc.2023.3278096
Vancouver
Chang Y, Li S, Liu A, Zhang W, Jin J, Xiang W. Bidirectional Feature Aggregation Network for Stereo Image Quality Assessment Considering Parallax Attention-Based Binocular Fusion. IEEE Transactions on Broadcasting. 2024;70(1):278-289. doi:10.1109/tbc.2023.3278096
BibTeX
@article{Chang2024,
author = {Chang, Yongli and Li, Sumei and Liu, Anqi and Zhang, Wenlin and Jin, Jie and Xiang, Wei},
title = {Bidirectional Feature Aggregation Network for Stereo Image Quality Assessment Considering Parallax Attention-Based Binocular Fusion},
journal = {IEEE Transactions on Broadcasting},
year = {2024},
volume = {70},
number = {1},
pages = {278--289},
doi = {10.1109/tbc.2023.3278096}
}
EUVIMED