EUVIMEDEUVIMED entdecken
EvaluationsstudieOpen Access · CC BY 4.0

Evaluation of AI‐based auto‐contouring tools in radiotherapy: A single‐institution study

Tingyu Wang iD, James Tam, Thomas Chum, Cyril Tai, Deborah C Marshall, Michael Buckstein, Jerry Liu, Sheryl Green, Robert D Stewart, Tian Liu, Ming Chao

Journal of Applied Clinical Medical Physics · 2025

DOI: 10.1002/acm2.14620 ↗

Kurz gefasst

Evaluationsstudie in der Zeitschrift Journal of Applied Clinical Medical Physics, 2025. Verfasst von Tingyu Wang und 10 weiteren Autor:innen. Beteiligte Einrichtung: Department of Radiation Oncology, Icahn School of Medicine at Mount Sinai, New York, New York, USA. Hauptthemen laut MEDLINE: Radiotherapy Planning, Computer-Assisted, Organs at Risk, Software, Artificial Intelligence. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 18 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NIH HHS, Mount Sinai Health System.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Accurate delineation of organs at risk (OARs) is crucial yet time‐consuming in the radiotherapy treatment planning workflow. Modern artificial intelligence (AI) technologies had made automation of OAR contouring feasible. This report details a single institution's experience in evaluating two commercial auto‐contouring software tools and making well‐informed decisions about their clinical adoption.

Methods

A cohort of 36 patients previously treated at our institution were selected for the software performance assessment. Fifty‐eight OAR structures from seven disease sites were automatically segmented with each tool. Five radiation oncologists with different specialties qualitatively scored the automatic OAR contours’ clinical usability by a 4‐level scale (0–3), termed as quality score (QS), representing from “0: not usable” to “3: directly usable for a clinic.” Additionally, quantitative comparison with clinically approved contours using Dice similarity coefficient (DSC) and the 95% Hausdorff distance (HD95) was performed in complement to QS from physicians.

Result

Software A achieved an average QS of 2.17 ± 0.69, comparable to Software B's average QS of 2.17 ± 0.72. Software B performed better with more OARs (42 vs. 37) that required minor or no modification than Software A. Major modifications were needed for 13 out of 58 automated contours from both tools. Both DSC and HD95 scores for the two tools were comparable to each other, with DSC: 0.67 ± 0.23 versus 0.66 ± 0.21 and HD95: 13.07 ± 15.84 versus 15.55 ± 18.45 for Software A and Software B, respectively. Correlation coefficients between the physician score and the quantitative metrics suggested that the contouring results from Software A aligned more closely with the physician's evaluations.

Conclusion

Based on our study, either software tool could produce clinically acceptable contours for about 65% of the OAR structures. However, further refinement is necessary for several challenging OARs to improve model performance.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Radiotherapy Planning, Computer-AssistedOrgans at RiskSoftwareArtificial IntelligenceNeoplasmsImage Processing, Computer-AssistedHumansRadiotherapy DosageRadiotherapy, Intensity-ModulatedAlgorithms

Stichwörter der Autor:innen

Radiation therapyartificial intelligenceimage segmentationorgan at risktreatment planning

Autor:innen und Institutionen

  • Department of Radiation Oncology, Icahn School of Medicine at Mount Sinai, New York, New York, USA.
  • Department of Radiation Oncology, The Mount Sinai Hospital, New York, New York, USA.
  • Department of Radiation Oncology, Mount Sinai Union Square, New York, New York, USA.
  • Department of Population Health Science and Policy, Icahn School of Medicine at Mount Sinai, New York, New York, USA.

ORCID-Profile: Tingyu Wang

Förderung

  • NIH HHS
  • Mount Sinai Health System

Zitieren

APA

Wang, T., Tam, J., Chum, T., Tai, C., Marshall, D. C., Buckstein, M., Liu, J., Green, S., Stewart, R. D., Liu, T., & Chao, M. (2025). Evaluation of AI‐based auto‐contouring tools in radiotherapy: A single‐institution study. Journal of Applied Clinical Medical Physics. https://doi.org/10.1002/acm2.14620

Vancouver

Wang T, Tam J, Chum T, Tai C, Marshall DC, Buckstein M, et al. Evaluation of AI‐based auto‐contouring tools in radiotherapy: A single‐institution study. Journal of Applied Clinical Medical Physics. 2025. doi:10.1002/acm2.14620

BibTeX
@article{Wang2025,
  author = {Wang, Tingyu and Tam, James and Chum, Thomas and Tai, Cyril and Marshall, Deborah C and Buckstein, Michael and Liu, Jerry and Green, Sheryl and Stewart, Robert D and Liu, Tian and Chao, Ming},
  title = {Evaluation of AI‐based auto‐contouring tools in radiotherapy: A single‐institution study},
  journal = {Journal of Applied Clinical Medical Physics},
  year = {2025},
  doi = {10.1002/acm2.14620}
}
Kostenlos starten →