EUVIMEDEUVIMED entdecken
Crossref

Laplacian Pyramid Fusion Network With Hierarchical Guidance for Infrared and Visible Image Fusion

Jiaxin Yao, Yongqiang Zhao, Yuanyang Bu, Seong G. Kong, Jonathan Cheung-Wai Chan

IEEE Transactions on Circuits and Systems for Video Technology · 2023-09 · 33 (9) · 4630-4644

DOI: 10.1109/tcsvt.2023.3245607 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2023-09. Verfasst von Jiaxin Yao und 4 weiteren Autor:innen. Die Arbeit wurde bisher 94-mal zitiert (Crossref) und nennt 52 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Key Research and Development Plan of Shaanxi Province, Science, Technology and Innovation Commission of Shenzhen Municipality.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The fusion of infrared and visible images combines the information from two complementary imaging modalities for various computer vision tasks. Many existing techniques, however, fail to maintain a uniform overall style and keep salient details of individual modalities simultaneously. This paper presents an end-to-end Laplacian Pyramid Fusion Network with hierarchical guidance (HG-LPFN) that takes advantage of pixel-level saliency reservation of Laplacian Pyramid and global optimization capability of deep learning. The proposed scheme generates hierarchical saliency maps through Laplacian Pyramid decomposition and modal difference calculation. In the pyramid fusion mode, all sub-networks are connected in a bottom-up manner. The sub-network for low-frequency fusion focuses on extracting universal features to produce an opposite style while sub-networks for high-frequency fusion determine how much the details of each modality will be retained. Taking the style, details, and background into consideration, we design a set of novel loss functions to supervise both low-frequency images and full-resolution images under the guidance of saliency maps. Experimental results on public datasets demonstrate that the proposed HG-LPFN outperforms the state-of-the-art image fusion techniques.

Förderung

  • National Natural Science Foundation of China
  • Key Research and Development Plan of Shaanxi Province
  • Science, Technology and Innovation Commission of Shenzhen Municipality
  • Institute of Information and Communications Technology Planning and Evaluation
  • Ministry of Science and ICT (MSIT) of South Korea

Zitieren

APA

Yao, J., Zhao, Y., Bu, Y., Kong, S. G., & Chan, J. C. (2023). Laplacian Pyramid Fusion Network With Hierarchical Guidance for Infrared and Visible Image Fusion. IEEE Transactions on Circuits and Systems for Video Technology, 33(9), 4630-4644. https://doi.org/10.1109/tcsvt.2023.3245607

Vancouver

Yao J, Zhao Y, Bu Y, Kong SG, Chan JC. Laplacian Pyramid Fusion Network With Hierarchical Guidance for Infrared and Visible Image Fusion. IEEE Transactions on Circuits and Systems for Video Technology. 2023;33(9):4630-4644. doi:10.1109/tcsvt.2023.3245607

BibTeX
@article{Yao2023,
  author = {Yao, Jiaxin and Zhao, Yongqiang and Bu, Yuanyang and Kong, Seong G. and Chan, Jonathan Cheung-Wai},
  title = {Laplacian Pyramid Fusion Network With Hierarchical Guidance for Infrared and Visible Image Fusion},
  journal = {IEEE Transactions on Circuits and Systems for Video Technology},
  year = {2023},
  volume = {33},
  number = {9},
  pages = {4630--4644},
  doi = {10.1109/tcsvt.2023.3245607}
}
Kostenlos starten →