Multi-focused image fusion algorithm based on multi-scale hybrid attention residual network
PLOS ONE · 24.05.2024 · 19 (5) · e0302545
DOI: 10.1371/journal.pone.0302545 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS ONE, online erschienen am 24.05.2024. Verfasst von Tingting Liu und 3 weiteren Autor:innen. Beteiligte Einrichtung: Sichuan Key Laboratory of Artificial Intelligence, Sichuan University of Science and Engineering, Yibin, Sichuan, China. Hauptthemen laut MEDLINE: Algorithms, Image Processing, Computer-Assisted. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 61 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Natural Science Foundation of Sichuan, China, The Key Laboratory of Internet Information Retrieval of Hainan Province Research Found, the Opening Project of International Joint Research Center for Robotics and Intelligence System of Sichuan Province.
Abstract (Originalsprache)
In order to improve the detection performance of image fusion in focus areas and realize end-to-end decision diagram optimization, we design a multi-focus image fusion network based on deep learning. The network is trained using unsupervised learning and a multi-scale hybrid attention residual network model is introduced to enable solving for features at different levels of the image. In the training stage, multi-scale features are extracted from two source images with different focal points using hybrid multi-scale residual blocks (MSRB), and the up-down projection module (UDP) is introduced to obtain multi-scale edge information, then the extracted features are operated to obtain deeper image features. These blocks can effectively utilize multi-scale feature information without increasing the number of parameters. The deep features of the image are extracted in its test phase, input to the spatial frequency domain to calculate and measure the activity level and obtain the initial decision map, and use post-processing techniques to eliminate the edge errors. Finally, the decision map is generated and optimized, and the final fused image is obtained by combining the optimized decision map with the source image. The comparative experiments show that our proposed model achieves better fusion performance in subjective evaluation, and the quality of the obtained fused images is more robust with richer details. The objective evaluation metrics work better and the image fusion quality is higher.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Sichuan Key Laboratory of Artificial Intelligence, Sichuan University of Science and Engineering, Yibin, Sichuan, China.
- School of Automation and Information, Sichuan University of Science and Engineering, Yibin, Sichuan, China.
ORCID-Profile: Tingting Liu
Förderung
- Natural Science Foundation of Sichuan, China
- The Key Laboratory of Internet Information Retrieval of Hainan Province Research Found
- the Opening Project of International Joint Research Center for Robotics and Intelligence System of Sichuan Province
- Sichuan University of Science & Engineering Postgraduate Innovation Fund Project
Zitieren
APA
Liu, T., Chen, M., Duan, Z., & Cui, A. (2024). Multi-focused image fusion algorithm based on multi-scale hybrid attention residual network. PLOS ONE, 19(5), e0302545. https://doi.org/10.1371/journal.pone.0302545
Vancouver
Liu T, Chen M, Duan Z, Cui A. Multi-focused image fusion algorithm based on multi-scale hybrid attention residual network. PLOS ONE. 2024;19(5):e0302545. doi:10.1371/journal.pone.0302545
BibTeX
@article{Liu2024,
author = {Liu, Tingting and Chen, Mingju and Duan, Zhengxu and Cui, Anle},
title = {Multi-focused image fusion algorithm based on multi-scale hybrid attention residual network},
journal = {PLOS ONE},
year = {2024},
volume = {19},
number = {5},
pages = {e0302545},
doi = {10.1371/journal.pone.0302545}
}
EUVIMED