Medical Image Fusion Based on Multilevel Bidirectional Feature Interaction Network
IEEE Sensors Journal · 15.06.2024 · 24 (12) · 19428-19441
DOI: 10.1109/jsen.2024.3393619 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Sensors Journal, erschienen am 15.06.2024. Verfasst von Kai Shi und 4 weiteren Autor:innen. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 52 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Fundamental Research Funds for the Central Universities.
Abstract (Originalsprache)
Medical image fusion integrates multimodal images with complementary information to enhance the image quality in clinical diagnosis. This process typically involves three steps including feature extraction, feature fusion, and image reconstruction. However, most image fusion methods have limitations in simultaneously extracting specific and shared information from different modal images while considering cross-modal interaction, leading to incomplete feature extraction and fusion. Besides, the multilevel features’ interaction of most existing methods is insufficient, leading to defective utilization of fused information under different receptive fields. To address these issues, we propose an end-to-end medical image fusion network based on multilevel bidirectional feature interaction. The bidirectional feature interaction is manifested vertically and horizontally. First, we design a cross-modal interactive feature extraction module based on two modality-independent branches and a modality-shared branch, achieving vertical feature interaction between different modal features at the same level. Besides, we proposed a forward and backward interaction module (FBIM) to achieve multilevel horizontal feature interaction, which can bridge the gap of multilevel fused features and promote the utilization of fused information under different receptive fields. In addition, we design a fusion module to generate two weight maps based on the modality-shared branch to fuse two modality-independent features. Qualitative and quantitative experiments demonstrate the superiority of our method over the state-of-the-art fusion methods.
Förderung
- National Natural Science Foundation of China
- Fundamental Research Funds for the Central Universities
Zitieren
APA
Shi, K., Liu, A., Zhang, J., Liu, Y., & Chen, X. (2024). Medical Image Fusion Based on Multilevel Bidirectional Feature Interaction Network. IEEE Sensors Journal, 24(12), 19428-19441. https://doi.org/10.1109/jsen.2024.3393619
Vancouver
Shi K, Liu A, Zhang J, Liu Y, Chen X. Medical Image Fusion Based on Multilevel Bidirectional Feature Interaction Network. IEEE Sensors Journal. 2024;24(12):19428-19441. doi:10.1109/jsen.2024.3393619
BibTeX
@article{Shi2024,
author = {Shi, Kai and Liu, Aiping and Zhang, Jing and Liu, Yu and Chen, Xun},
title = {Medical Image Fusion Based on Multilevel Bidirectional Feature Interaction Network},
journal = {IEEE Sensors Journal},
year = {2024},
volume = {24},
number = {12},
pages = {19428--19441},
doi = {10.1109/jsen.2024.3393619}
}
EUVIMED