HyperTDP-Net: A Hyper-densely Connected Compression-and-Decomposition Network Based on Trident Dilated Perception for PET and MRI Image Fusion
Physics in Medicine & Biology · 2023
DOI: 10.1088/1361-6560/acdec3 ↗Kurz gefasst
Fachartikel in der Zeitschrift Physics in Medicine & Biology, 2023. Verfasst von Bicao Li und 6 weiteren Autor:innen. Beteiligte Einrichtung: School of Electronic and Information Engineering, Zhongyuan University of Technology, Zhengzhou 450007, People's Republic of China. Hauptthemen laut MEDLINE: Data Compression. Die Arbeit nennt 56 Literaturangaben. Gefördert von: Training Program of Young Master’s supervisor in Zhongyuan University of Technology, Research funds for overseas students in Henan Province, Program of Young backbone teachers in Zhongyuan University of Technology, This research was supported by the National Natural Science Foundation of China.
Abstract (Originalsprache)
Objective . Since medical images generated by medical devices have low spatial resolution and quality, fusion approaches on medical images can generate a fused image containing a more comprehensive range of different modal features to help physicians accurately diagnose diseases. Conventional methods based on deep learning for medical image fusion usually extract only local features without considering their global features, which often leads to the problem of unclear detail information in the final fused image. Therefore, medical image fusion is a challenging task of great relevance. Approach. This paper proposes a novel end-to-end medical image fusion model for PET and MRI images to achieve information interaction between different pathways, termed as hyper-densely connected compression-and-decomposition network based on trident dilated perception for PET and MRI image fusion (HyperTDP-Net). In particular, in the compression network, a dual residual hyper densely module is constructed to take full advantage of middle layer information. Moreover, we establish the trident dilated perception module to precisely determine the location information of features, and improve the feature representation capability of the network. In addition, we abandon the ordinary mean square error as the content loss function and propose a new content-aware loss consisting of structural similarity loss and gradient loss, so that the fused image not only contains rich texture details but also maintains sufficient structural similarity with the source images. Main results . The experimental dataset used in this paper is derived from multimodal medical images published by Harvard Medical School. Extensive experiments illustrate that our model contains more edge information and texture detail information in the fusion result than the 12 state-of-the-art fusion models and ablation study results demonstrate the effectiveness of three technical innovations. Significance . As medical images continue to be used in clinical diagnosis, our method is expected to be a tool that can effectively improve the accuracy of physician diagnosis and automatic machine detection.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Electronic and Information Engineering, Zhongyuan University of Technology, Zhengzhou 450007, People's Republic of China.
- University Infirmary, Zhongyuan University of Technology, Zhengzhou 450007, People's Republic of China.
- College of Information Engineering, Capital Normal University, Beijing 100048, People's Republic of China.
ORCID-Profile: Bicao Li
Förderung
- Training Program of Young Master’s supervisor in Zhongyuan University of Technology
- Research funds for overseas students in Henan Province, Program of Young backbone teachers in Zhongyuan University of Technology
- This research was supported by the National Natural Science Foundation of China
- Science and technology innovation talent project of Education Department of Henan Province
Zitieren
APA
Li, B., Du, Y., Wang, B., Shao, Z., Huang, J., Wei, M., & Lu, J. (2023). HyperTDP-Net: A Hyper-densely Connected Compression-and-Decomposition Network Based on Trident Dilated Perception for PET and MRI Image Fusion. Physics in Medicine & Biology. https://doi.org/10.1088/1361-6560/acdec3
Vancouver
Li B, Du Y, Wang B, Shao Z, Huang J, Wei M, et al. HyperTDP-Net: A Hyper-densely Connected Compression-and-Decomposition Network Based on Trident Dilated Perception for PET and MRI Image Fusion. Physics in Medicine & Biology. 2023. doi:10.1088/1361-6560/acdec3
BibTeX
@article{Li2023,
author = {Li, Bicao and Du, Yifan and Wang, Bei and Shao, Zhuhong and Huang, Jie and Wei, Miaomiao and Lu, Jiaxi},
title = {HyperTDP-Net: A Hyper-densely Connected Compression-and-Decomposition Network Based on Trident Dilated Perception for PET and MRI Image Fusion},
journal = {Physics in Medicine & Biology},
year = {2023},
doi = {10.1088/1361-6560/acdec3}
}
EUVIMED