EUVIMEDDescubrir EUVIMED
Open access

Synthetic CT generation from MRI using 3D transformer‐based denoising diffusion model

Shaoyan Pan, Elham Abouei, Jacob Wynne, Chih-Wei Chang, Tonghe Wang, Richard L J Qiu, Yuheng Li, Junbo Peng, Justin Roper, Pretesh Patel, David S Yu, Hui Mao and 1 more

Medical Physics · 2024-04 · 51 (4) · 2538-2548

DOI: 10.1002/mp.16847 ↗

At a glance

Journal article in Medical Physics, published online on 2023-11-27. Written by Shaoyan Pan and 12 co-authors. Institution: Department of Radiation Oncology and Winship Cancer Institute, Emory University, Atlanta, Georgia, USA. Major MEDLINE topics: Tomography, X-Ray Computed, Head. Cited 127 times so far (Crossref); 34 references. The full text is freely available in PubMed Central. Funded by: NIH HHS, NCI NIH HHS, NIBIB NIH HHS.

ResumenSubjectsDatos bibliográficosCiteRelated studies

Abstract (original language)

Background and purpose Magnetic resonance imaging (MRI)‐based synthetic computed tomography (sCT) simplifies radiation therapy treatment planning by eliminating the need for CT simulation and error‐prone image registration, ultimately reducing patient radiation dose and setup uncertainty. In this work, we propose a MRI‐to‐CT transformer‐based improved denoising diffusion probabilistic model (MC‐IDDPM) to translate MRI into high‐quality sCT to facilitate radiation treatment planning.

Methods

MC‐IDDPM implements diffusion processes with a shifted‐window transformer network to generate sCT from MRI. The proposed model consists of two processes: a forward process, which involves adding Gaussian noise to real CT scans to create noisy images, and a reverse process, in which a shifted‐window transformer V‐net (Swin‐Vnet) denoises the noisy CT scans conditioned on the MRI from the same patient to produce noise‐free CT scans. With an optimally trained Swin‐Vnet, the reverse diffusion process was used to generate noise‐free sCT scans matching MRI anatomy. We evaluated the proposed method by generating sCT from MRI on an institutional brain dataset and an institutional prostate dataset. Quantitative evaluations were conducted using several metrics, including Mean Absolute Error (MAE), Peak Signal‐to‐Noise Ratio (PSNR), Multi‐scale Structure Similarity Index (SSIM), and Normalized Cross Correlation (NCC). Dosimetry analyses were also performed, including comparisons of mean dose and target dose coverages for 95% and 99%.

Results

MC‐IDDPM generated brain sCTs with state‐of‐the‐art quantitative results with MAE 48.825 ± 21.491 HU, PSNR 26.491 ± 2.814 dB, SSIM 0.947 ± 0.032, and NCC 0.976 ± 0.019. For the prostate dataset: MAE 55.124 ± 9.414 HU, PSNR 28.708 ± 2.112 dB, SSIM 0.878 ± 0.040, and NCC 0.940 ± 0.039. MC‐IDDPM demonstrates a statistically significant improvement (with p < 0.05) in most metrics when compared to competing networks, for both brain and prostate synthetic CT. Dosimetry analyses indicated that the target dose coverage differences by using CT and sCT were within ± 0.34%.

Conclusions

We have developed and validated a novel approach for generating CT images from routine MRIs using a transformer‐based improved DDPM. This model effectively captures the complex relationship between CT and MRI images, allowing for robust and high‐quality synthetic CT images to be generated in a matter of minutes. This approach has the potential to greatly simplify the treatment planning process for radiation therapy by eliminating the need for additional CT scans, reducing the amount of time patients spend in treatment planning, and enhancing the accuracy of treatment delivery.

Subjects

MeSH terms (MEDLINE)

Tomography, X-Ray ComputedHeadMaleHumansMagnetic Resonance ImagingRadiotherapy Planning, Computer-AssistedRadiometryImage Processing, Computer-Assisted

Author keywords

MRIdeep learningdiffusion modelsynthetic CTtransformer

Authors and institutions

  • Department of Radiation Oncology and Winship Cancer Institute, Emory University, Atlanta, Georgia, USA.
  • Department of Biomedical Informatics, Emory University, Atlanta, Georgia, USA.
  • Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York, New York, USA.
  • Department of Radiology and Imaging Sciences, Winship Cancer Institute, Atlanta, Georgia, USA.

Funding

  • NIH HHS
  • NCI NIH HHS
  • NIBIB NIH HHS
  • National Institutes of Health

Cite

APA

Pan, S., Abouei, E., Wynne, J., Chang, C. W., Wang, T., Qiu, R. L. J., Li, Y., Peng, J., Roper, J., Patel, P., Yu, D. S., Mao, H., & Yang, X. (2024). Synthetic CT generation from MRI using 3D transformer‐based denoising diffusion model. Medical Physics, 51(4), 2538-2548. https://doi.org/10.1002/mp.16847

Vancouver

Pan S, Abouei E, Wynne J, Chang CW, Wang T, Qiu RLJ, et al. Synthetic CT generation from MRI using 3D transformer‐based denoising diffusion model. Medical Physics. 2024;51(4):2538-2548. doi:10.1002/mp.16847

BibTeX
@article{Pan2024,
  author = {Pan, Shaoyan and Abouei, Elham and Wynne, Jacob and Chang, Chih-Wei and Wang, Tonghe and Qiu, Richard L J and Li, Yuheng and Peng, Junbo and Roper, Justin and Patel, Pretesh and Yu, David S and Mao, Hui and Yang, Xiaofeng},
  title = {Synthetic CT generation from MRI using 3D transformer‐based denoising diffusion model},
  journal = {Medical Physics},
  year = {2024},
  volume = {51},
  number = {4},
  pages = {2538--2548},
  doi = {10.1002/mp.16847}
}
Start for free →