EUVIMEDEUVIMED entdecken
Open Access

Pure Vision Transformer (CT-ViT) with Noise2Neighbors Interpolation for Low-Dose CT Image Denoising

Luella Marcos, Paul Babyn, Javad Alirezaie iD

Journal of Imaging Informatics in Medicine · 15.04.2024 · 37 (5) · 2669-2687

DOI: 10.1007/s10278-024-01108-8 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Imaging Informatics in Medicine, online erschienen am 15.04.2024. Verfasst von Luella Marcos und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electrical, Biomedical and Computer Engineering, Toronto Metropolitan University (formerly Ryerson University), 350 Victoria Street, To…. Hauptthemen laut MEDLINE: Tomography, X-Ray Computed, Neural Networks, Computer. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 42 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: Natural Sciences and Engineering Research Council of Canada.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Convolutional neural networks (CNN) have been used for a wide variety of deep learning applications, especially in computer vision. For medical image processing, researchers have identified certain challenges associated with CNNs. These challenges encompass the generation of less informative features, limitations in capturing both high and low-frequency information within feature maps, and the computational cost incurred when enhancing receptive fields by deepening the network. Transformers have emerged as an approach aiming to address and overcome these specific limitations of CNNs in the context of medical image analysis. Preservation of all spatial details of medical images is necessary to ensure accurate patient diagnosis. Hence, this research introduced the use of a pure Vision Transformer (ViT) for a denoising artificial neural network for medical image processing specifically for low-dose computed tomography (LDCT) image denoising. The proposed model follows a U-Net framework that contains ViT modules with the integration of Noise2Neighbor (N2N) interpolation operation. Five different datasets containing LDCT and normal-dose CT (NDCT) image pairs were used to carry out this experiment. To test the efficacy of the proposed model, this experiment includes comparisons between the quantitative and visual results among CNN-based (BM3D, RED-CNN, DRL-E-MP), hybrid CNN-ViT-based (TED-Net), and the proposed pure ViT-based denoising model. The findings of this study showed that there is about 15-20% increase in SSIM and PSNR when using self-attention transformers than using the typical pure CNN. Visual results also showed improvements especially when it comes to showing fine structural details of CT images.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Tomography, X-Ray ComputedNeural Networks, ComputerHumansImage Processing, Computer-AssistedSignal-To-Noise RatioDeep LearningRadiation DosageAlgorithms

Stichwörter der Autor:innen

CT denoisingConvolutional neural networksDeep learningMachine learningMedical image processingVision transformers

Autor:innen und Institutionen

  • Department of Electrical, Biomedical and Computer Engineering, Toronto Metropolitan University (formerly Ryerson University), 350 Victoria Street, Toronto, M5B 2K3, Ontario, Canada.
  • Department of Medical Imaging, University of Saskatchewan, 105 Administration Pl, Saskatoon, SK S7N0W8, Saskatchewan, Canada.
  • Department of Electrical, Biomedical and Computer Engineering, Toronto Metropolitan University (formerly Ryerson University), 350 Victoria Street, Toronto, M5B 2K3, Ontario, Canada. javad@torontomu.ca.

ORCID-Profile: Javad Alirezaie

Förderung

  • Natural Sciences and Engineering Research Council of Canada

Zitieren

APA

Marcos, L., Babyn, P., & Alirezaie, J. (2024). Pure Vision Transformer (CT-ViT) with Noise2Neighbors Interpolation for Low-Dose CT Image Denoising. Journal of Imaging Informatics in Medicine, 37(5), 2669-2687. https://doi.org/10.1007/s10278-024-01108-8

Vancouver

Marcos L, Babyn P, Alirezaie J. Pure Vision Transformer (CT-ViT) with Noise2Neighbors Interpolation for Low-Dose CT Image Denoising. Journal of Imaging Informatics in Medicine. 2024;37(5):2669-2687. doi:10.1007/s10278-024-01108-8

BibTeX
@article{Marcos2024,
  author = {Marcos, Luella and Babyn, Paul and Alirezaie, Javad},
  title = {Pure Vision Transformer (CT-ViT) with Noise2Neighbors Interpolation for Low-Dose CT Image Denoising},
  journal = {Journal of Imaging Informatics in Medicine},
  year = {2024},
  volume = {37},
  number = {5},
  pages = {2669--2687},
  doi = {10.1007/s10278-024-01108-8}
}
Kostenlos starten →