EUVIMEDEUVIMED entdecken
Crossref

A general image fusion framework using multi-task semi-supervised learning

Wu Wang, Liang-Jian Deng, Gemine Vivone

Information Fusion · 2024-08 · 108 · 102414

DOI: 10.1016/j.inffus.2024.102414 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Information Fusion, 2024-08. Verfasst von Wu Wang und 2 weiteren Autor:innen. Die Arbeit wurde bisher 77-mal zitiert (Crossref) und nennt 72 Literaturangaben. Gefördert von: National Natural Science Foundation of China, National Key Research and Development Program of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Existing image fusion methods primarily focus on solving single-task fusion problems, overlooking the potential information complementarity among multiple fusion tasks. Additionally, there has been no prior research in the field of image fusion that explores the mixed training of labeled and unlabeled data for different fusion tasks. To address these gaps, this paper introduces a novel multi-task semi-supervised learning approach to construct a general image fusion framework. This framework not only facilitates collaborative training for multiple fusion tasks, thereby achieving effective information complementarity among datasets from different fusion tasks, but also promotes the (unsupervised) learning of unlabeled data via the (supervised) learning of labeled data. Regarding the specific network module, we propose a so-called pseudo-siamese Laplacian pyramid transformer (PSLPT), which can effectively distinguish information at different frequencies in source images and discriminatively fuse features from distinct frequencies. More specifically, we take datasets of four typical image fusion tasks into the same PSLPT for weight updates, yielding the final general fusion model. Extensive experiments demonstrate that the obtained general fusion model exhibits promising outcomes for all four image fusion tasks, both visually and quantitatively. Moreover, comprehensive ablation and discussion experiments corroborate the effectiveness of the proposed method. The code is available at https:

Förderung

  • National Natural Science Foundation of China
  • National Key Research and Development Program of China

Zitieren

APA

Wang, W., Deng, L., & Vivone, G. (2024). A general image fusion framework using multi-task semi-supervised learning. Information Fusion, 108, 102414. https://doi.org/10.1016/j.inffus.2024.102414

Vancouver

Wang W, Deng L, Vivone G. A general image fusion framework using multi-task semi-supervised learning. Information Fusion. 2024;108:102414. doi:10.1016/j.inffus.2024.102414

BibTeX
@article{Wang2024,
  author = {Wang, Wu and Deng, Liang-Jian and Vivone, Gemine},
  title = {A general image fusion framework using multi-task semi-supervised learning},
  journal = {Information Fusion},
  year = {2024},
  volume = {108},
  pages = {102414},
  doi = {10.1016/j.inffus.2024.102414}
}
Kostenlos starten →