EUVIMEDOpdag EUVIMED
Open access · CC BY-NC 4.0

Deep learning‐based conditional inpainting for restoration of artifact‐affected 4D CT images

Frederic Madesta, Thilo Sentker, Tobias Gauer, René Werner

Medical Physics · 2024

DOI: 10.1002/mp.16851 ↗

At a glance

Journal article in Medical Physics, 2024. Written by Frederic Madesta and 3 co-authors. Institution: Department of Computational Neuroscience, University Medical Center Hamburg-Eppendorf, Hamburg, Germany. Major MEDLINE topics: Deep Learning, Artifacts, Four-Dimensional Computed Tomography, Image Processing, Computer-Assisted. Cited 16 times so far (Crossref); 39 references. The full text is freely available (open access, CC BY-NC 4.0). Funded by: DFG, Siemens Healthineers AG, Deutsche Forschungsgemeinschaft.

AbstractSubjectsBibliografiske oplysningerCiteRelated studies

Abstract (original language)

Background

4D CT imaging is an essential component of radiotherapy of thoracic and abdominal tumors. 4D CT images are, however, often affected by artifacts that compromise treatment planning quality and image information reliability.

Purpose

In this work, deep learning (DL)‐based conditional inpainting is proposed to restore anatomically correct image information of artifact‐affected areas.

Methods

The restoration approach consists of a two‐stage process: DL‐based detection of common interpolation (INT) and double structure (DS) artifacts, followed by conditional inpainting applied to the artifact areas. In this context, conditional refers to a guidance of the inpainting process by patient‐specific image data to ensure anatomically reliable results. The study is based on 65 in‐house 4D CT images of lung cancer patients (48 with only slight artifacts, 17 with pronounced artifacts) and two publicly available 4D CT data sets that serve as independent external test sets.

Results

Automated artifact detection revealed a ROC‐AUC of 0.99 for INT and of 0.97 for DS artifacts (in‐house data). The proposed inpainting method decreased the average root mean squared error (RMSE) by 52 % (INT) and 59 % (DS) for the in‐house data. For the external test data sets, the RMSE improvement is similar (50 % and 59 %, respectively). Applied to 4D CT data with pronounced artifacts (not part of the training set), 72 % of the detectable artifacts were removed.

Conclusions

The results highlight the potential of DL‐based inpainting for restoration of artifact‐affected 4D CT data. Compared to recent 4D CT inpainting and restoration approaches, the proposed methodology illustrates the advantages of exploiting patient‐specific prior image information.

Subjects

MeSH terms (MEDLINE)

Deep LearningArtifactsFour-Dimensional Computed TomographyImage Processing, Computer-AssistedHumansLung Neoplasms

Author keywords

4D CTdeep learninginpaintingmotion artifactsradiotherapy

Authors and institutions

  • Department of Computational Neuroscience, University Medical Center Hamburg-Eppendorf, Hamburg, Germany.
  • Institute for Applied Medical Informatics, University Medical Center Hamburg-Eppendorf, Hamburg, Germany.
  • Center for Biomedical Artificial Intelligence (bAIome), University Medical Center Hamburg-Eppendorf, Hamburg, Germany.
  • Department of Radiotherapy and Radiation Oncology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany.

Funding

  • DFG
  • Siemens Healthineers AG
  • Deutsche Forschungsgemeinschaft
  • Siemens Healthineers

Cite

APA

Madesta, F., Sentker, T., Gauer, T., & Werner, R. (2024). Deep learning‐based conditional inpainting for restoration of artifact‐affected 4D CT images. Medical Physics. https://doi.org/10.1002/mp.16851

Vancouver

Madesta F, Sentker T, Gauer T, Werner R. Deep learning‐based conditional inpainting for restoration of artifact‐affected 4D CT images. Medical Physics. 2024. doi:10.1002/mp.16851

BibTeX
@article{Madesta2024,
  author = {Madesta, Frederic and Sentker, Thilo and Gauer, Tobias and Werner, René},
  title = {Deep learning‐based conditional inpainting for restoration of artifact‐affected 4D CT images},
  journal = {Medical Physics},
  year = {2024},
  doi = {10.1002/mp.16851}
}
Start for free →