EUVIMEDEUVIMED entdecken
Crossref

Image Fusion Based on Prior Information

Congbing He, Zhenhong Jia, Hui Zhao, Sensen Song, Jiajia Wang, Fei Shi

IEEE Transactions on Pattern Analysis and Machine Intelligence · 2026-10 · 48 (10) · 11682-11699

DOI: 10.1109/tpami.2026.3690497 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2026-10. Verfasst von Congbing He und 5 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 54 Literaturangaben. Gefördert von: Key Research and Development Project of Science and Technology in Xinjiang Uygur Autonomous Region, Tianshan Talent Training Project-Xinjiang Science and Technology.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Existing feature extraction-based image fusion methods have an initial output of noise and iteratively refine them toward the target through training. This approach results in slow convergence and unstable training, with suboptimal fusion quality. To address these limitations, we propose prior-based fusion (PBF), a novel paradigm that constructs the fused output using multi-source image priors as its structural foundation, unlike noise-initialized approaches. This strategy enables faster and more stable training, while allowing the model to focus on complementary information exploration and detail enhancement, ultimately achieving superior fusion quality. Building upon the PBF paradigm, we propose PBFNet, a general-purpose image fusion framework, with its unified version PBFNet-U. They use a manually designed fusion criterion as the switching function to achieve optimal prior information extraction with only a slight increase in model complexity. The novel dense residual dense block is used as a feature extraction block, and at the same time creates a continuous memory between convolutional blocks and convolutional layers, which has a stronger feature extraction capability than residual block, dense block, residual dense block, and aggregated residual dense block. Furthermore, a channel attention mechanism is incorporated to adaptively fuse encoded features, and a gradient-enhanced loss function is designed to improve gradient perception. Both quantitative metrics and visual assessments demonstrate that PBFNet and its unified version surpass state-of-the-art methods across four fusion tasks. The results of ablation studies and discussion and analysis demonstrate the significant advantages of the proposed paradigm and method in stabilizing training, accelerating convergence, and improving fusion performance.

Förderung

  • Key Research and Development Project of Science and Technology in Xinjiang Uygur Autonomous Region
  • Tianshan Talent Training Project-Xinjiang Science and Technology

Zitieren

APA

He, C., Jia, Z., Zhao, H., Song, S., Wang, J., & Shi, F. (2026). Image Fusion Based on Prior Information. IEEE Transactions on Pattern Analysis and Machine Intelligence, 48(10), 11682-11699. https://doi.org/10.1109/tpami.2026.3690497

Vancouver

He C, Jia Z, Zhao H, Song S, Wang J, Shi F. Image Fusion Based on Prior Information. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2026;48(10):11682-11699. doi:10.1109/tpami.2026.3690497

BibTeX
@article{He2026,
  author = {He, Congbing and Jia, Zhenhong and Zhao, Hui and Song, Sensen and Wang, Jiajia and Shi, Fei},
  title = {Image Fusion Based on Prior Information},
  journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
  year = {2026},
  volume = {48},
  number = {10},
  pages = {11682--11699},
  doi = {10.1109/tpami.2026.3690497}
}
Kostenlos starten →