Deep Transfer Learning-Based Multi-Modal Digital Twins for Enhancement and Diagnostic Analysis of Brain MRI Image
IEEE/ACM Transactions on Computational Biology and Bioinformatics · 01.07.2023 · 20 (4) · 2407-2419
DOI: 10.1109/tcbb.2022.3168189 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE/ACM Transactions on Computational Biology and Bioinformatics, erschienen am 01.07.2023. Verfasst von Jinxia Wang und 3 weiteren Autor:innen. Die Arbeit wurde bisher 47-mal zitiert (Crossref) und nennt 30 Literaturangaben.
Abstract (Originalsprache)
OBJECTIVE: it aims to adopt deep transfer learning combined with Digital Twins (DTs) in Magnetic Resonance Imaging (MRI) medical image enhancement. METHODS: MRI image enhancement method based on metamaterial composite technology is proposed by analyzing the application status of DTs in medical direction and the principle of MRI imaging. On the basis of deep transfer learning, MRI super-resolution deep neural network structure is established. To address the problem that different medical imaging methods have advantages and disadvantages, a multi-mode medical image fusion algorithm based on adaptive decomposition is proposed and verified by experiments. RESULTS: the optimal Peak Signal to Noise Ratio (PSNR) of 34.11dB can be obtained by introducing modified linear element and loss function of deep transfer learning neural network structure. The Structural Similarity Coefficient (SSIM) is 85.24%. It indicates that the MRI truthfulness and sharpness obtained by adding composite metasurface are improved greatly. The proposed medical image fusion algorithm has the highest overall score in the subjective evaluation of the six groups of fusion image results. Group III had the highest score in Magnetic Resonance Imaging- Positron Emission Computed Tomography (MRI-PET) image fusion, with a score of 4.67, close to the full score of 5. As for the objective evaluation in group I of Magnetic Resonance Imaging- Single Photon Emission Computed Tomography (MRI-SPECT) images, the Root Mean Square Error (RMSE), Relative Average Spectral Error (RASE) and Spectral Angle Mapper (SAM) are the highest, which are 39.2075, 116.688, and 0.594, respectively. Mutual Information (MI) is 5.8822. CONCLUSION: the proposed algorithm has better performance than other algorithms in preserving spatial details of MRI images and color information direction of SPECT images, and the other five groups have achieved similar results.
Zitieren
APA
Wang, J., Qiao, L., Lv, H., & Lv, Z. (2023). Deep Transfer Learning-Based Multi-Modal Digital Twins for Enhancement and Diagnostic Analysis of Brain MRI Image. IEEE/ACM Transactions on Computational Biology and Bioinformatics, 20(4), 2407-2419. https://doi.org/10.1109/tcbb.2022.3168189
Vancouver
Wang J, Qiao L, Lv H, Lv Z. Deep Transfer Learning-Based Multi-Modal Digital Twins for Enhancement and Diagnostic Analysis of Brain MRI Image. IEEE/ACM Transactions on Computational Biology and Bioinformatics. 2023;20(4):2407-2419. doi:10.1109/tcbb.2022.3168189
BibTeX
@article{Wang2023,
author = {Wang, Jinxia and Qiao, Liang and Lv, Haibin and Lv, Zhihan},
title = {Deep Transfer Learning-Based Multi-Modal Digital Twins for Enhancement and Diagnostic Analysis of Brain MRI Image},
journal = {IEEE/ACM Transactions on Computational Biology and Bioinformatics},
year = {2023},
volume = {20},
number = {4},
pages = {2407--2419},
doi = {10.1109/tcbb.2022.3168189}
}
EUVIMED