Pure Vision Transformer (CT-ViT) with Noise2Neighbors Interpolation for Low-Dose CT Image Denoising
Journal of Imaging Informatics in Medicine · 15.04.2024 · 37 (5) · 2669-2687
DOI: 10.1007/s10278-024-01108-8 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Imaging Informatics in Medicine, online erschienen am 15.04.2024. Verfasst von Luella Marcos und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electrical, Biomedical and Computer Engineering, Toronto Metropolitan University (formerly Ryerson University), 350 Victoria Street, To…. Hauptthemen laut MEDLINE: Tomography, X-Ray Computed, Neural Networks, Computer. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 42 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: Natural Sciences and Engineering Research Council of Canada.
Abstract (Originalsprache)
Convolutional neural networks (CNN) have been used for a wide variety of deep learning applications, especially in computer vision. For medical image processing, researchers have identified certain challenges associated with CNNs. These challenges encompass the generation of less informative features, limitations in capturing both high and low-frequency information within feature maps, and the computational cost incurred when enhancing receptive fields by deepening the network. Transformers have emerged as an approach aiming to address and overcome these specific limitations of CNNs in the context of medical image analysis. Preservation of all spatial details of medical images is necessary to ensure accurate patient diagnosis. Hence, this research introduced the use of a pure Vision Transformer (ViT) for a denoising artificial neural network for medical image processing specifically for low-dose computed tomography (LDCT) image denoising. The proposed model follows a U-Net framework that contains ViT modules with the integration of Noise2Neighbor (N2N) interpolation operation. Five different datasets containing LDCT and normal-dose CT (NDCT) image pairs were used to carry out this experiment. To test the efficacy of the proposed model, this experiment includes comparisons between the quantitative and visual results among CNN-based (BM3D, RED-CNN, DRL-E-MP), hybrid CNN-ViT-based (TED-Net), and the proposed pure ViT-based denoising model. The findings of this study showed that there is about 15-20% increase in SSIM and PSNR when using self-attention transformers than using the typical pure CNN. Visual results also showed improvements especially when it comes to showing fine structural details of CT images.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Electrical, Biomedical and Computer Engineering, Toronto Metropolitan University (formerly Ryerson University), 350 Victoria Street, Toronto, M5B 2K3, Ontario, Canada.
- Department of Medical Imaging, University of Saskatchewan, 105 Administration Pl, Saskatoon, SK S7N0W8, Saskatchewan, Canada.
- Department of Electrical, Biomedical and Computer Engineering, Toronto Metropolitan University (formerly Ryerson University), 350 Victoria Street, Toronto, M5B 2K3, Ontario, Canada. javad@torontomu.ca.
ORCID-Profile: Javad Alirezaie
Förderung
- Natural Sciences and Engineering Research Council of Canada
Zitieren
APA
Marcos, L., Babyn, P., & Alirezaie, J. (2024). Pure Vision Transformer (CT-ViT) with Noise2Neighbors Interpolation for Low-Dose CT Image Denoising. Journal of Imaging Informatics in Medicine, 37(5), 2669-2687. https://doi.org/10.1007/s10278-024-01108-8
Vancouver
Marcos L, Babyn P, Alirezaie J. Pure Vision Transformer (CT-ViT) with Noise2Neighbors Interpolation for Low-Dose CT Image Denoising. Journal of Imaging Informatics in Medicine. 2024;37(5):2669-2687. doi:10.1007/s10278-024-01108-8
BibTeX
@article{Marcos2024,
author = {Marcos, Luella and Babyn, Paul and Alirezaie, Javad},
title = {Pure Vision Transformer (CT-ViT) with Noise2Neighbors Interpolation for Low-Dose CT Image Denoising},
journal = {Journal of Imaging Informatics in Medicine},
year = {2024},
volume = {37},
number = {5},
pages = {2669--2687},
doi = {10.1007/s10278-024-01108-8}
}
EUVIMED