EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Deep learning in computed tomography super resolution using multi‐modality data training

Wai Yan Ryana Fok, Andreas Fieselmann, Magdalena Herbst, Ludwig Ritschl, Steffen Kappler, Sylvia Saalfeld

Medical Physics · 2024-04 · 51 (4) · 2846-2860

DOI: 10.1002/mp.16825 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Medical Physics, online erschienen am 16.11.2023. Verfasst von Wai Yan Ryana Fok und 5 weiteren Autor:innen. Beteiligte Einrichtung: X-ray Products, Siemens Healthcare GmbH, Forchheim, Germany. Hauptthemen laut MEDLINE: Image Processing, Computer-Assisted, Deep Learning. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 53 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

One of the limitations in leveraging the potential of artificial intelligence in X‐ray imaging is the limited availability of annotated training data. As X‐ray and CT shares similar imaging physics, one could achieve cross‐domain data sharing, so to generate labeled synthetic X‐ray images from annotated CT volumes as digitally reconstructed radiographs (DRRs). To account for the lower resolution of CT and the CT‐generated DRRs as compared to the real X‐ray images, we propose the use of super‐resolution (SR) techniques to enhance the CT resolution before DRR generation.

Purpose

As spatial resolution can be defined by the modulation transfer function kernel in CT physics, we propose to train a SR network using paired low‐resolution (LR) and high‐resolution (HR) images by varying the kernel's shape and cutoff frequency. This is different to previous deep learning‐based SR techniques on RGB and medical images which focused on refining the sampling grid. Instead of generating LR images by bicubic interpolation, we aim to create realistic multi‐detector CT (MDCT) like LR images from HR cone‐beam CT (CBCT) scans.

Methods

We propose and evaluate the use of a SR U‐Net for the mapping between LR and HR CBCT image slices. We reconstructed paired LR and HR training volumes from the same CT scans with small in‐plane sampling grid size of . We used the residual U‐Net architecture to train two models. SRUN: trained with kernel‐based LR images, and SRUN: trained with bicubic downsampled data as baseline. Both models are trained on one CBCT dataset ( n = 13 391). The performance of both models was then evaluated on unseen kernel‐based and interpolation‐based LR CBCT images ( n = 10 950), and also on MDCT images ( n = 1392).

Results

Five‐fold cross validation and ablation study were performed to find the optimal hyperparameters. Both SRUN and SRUN models show significant improvements ( p ‐value 0.05) in mean absolute error (MAE), peak signal‐to‐noise ratio (PSNR) and structural similarity index measures (SSIMs) on unseen CBCT images. Also, the improvement percentages in MAE, PSNR, and SSIM by SRUN is larger than SRUN. For SRUN, MAE is reduced by 14%, and PSNR and SSIMs increased by 6 and 8%, respectively. To conclude, SRUN outperforms SRUN, which the former generates sharper images when tested with kernel‐based LR CBCT images as well as cross‐modality LR MDCT data.

Conclusions

Our proposed method showed better performance than the baseline interpolation approach on unseen LR CBCT. We showed that the frequency behavior of the used data is important for learning the SR features. Additionally, we showed cross‐modality resolution improvements to LR MDCT images. Our approach is, therefore, a first and essential step in enabling realistic high spatial resolution CT‐generated DRRs for deep learning training.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Image Processing, Computer-AssistedDeep LearningArtificial IntelligenceTomography, X-Ray ComputedCone-Beam Computed Tomography

Stichwörter der Autor:innen

cone‐beam computed tomographydeep learningmultimodalitysuper resolution

Autor:innen und Institutionen

  • X-ray Products, Siemens Healthcare GmbH, Forchheim, Germany.
  • Faculty of Computer Science, Otto-von-Guericke University of Magdeburg, Magdeburg, Germany.
  • Computational Medicine Group, Ilmenau University of Technology, Ilmenau, Germany.
  • Research Campus STIMULATE, Otto-von-Guericke University of Magdeburg, Magdeburg, Germany.

Zitieren

APA

Fok, W. Y. R., Fieselmann, A., Herbst, M., Ritschl, L., Kappler, S., & Saalfeld, S. (2024). Deep learning in computed tomography super resolution using multi‐modality data training. Medical Physics, 51(4), 2846-2860. https://doi.org/10.1002/mp.16825

Vancouver

Fok WYR, Fieselmann A, Herbst M, Ritschl L, Kappler S, Saalfeld S. Deep learning in computed tomography super resolution using multi‐modality data training. Medical Physics. 2024;51(4):2846-2860. doi:10.1002/mp.16825

BibTeX
@article{Fok2024,
  author = {Fok, Wai Yan Ryana and Fieselmann, Andreas and Herbst, Magdalena and Ritschl, Ludwig and Kappler, Steffen and Saalfeld, Sylvia},
  title = {Deep learning in computed tomography super resolution using multi‐modality data training},
  journal = {Medical Physics},
  year = {2024},
  volume = {51},
  number = {4},
  pages = {2846--2860},
  doi = {10.1002/mp.16825}
}
Kostenlos starten →