EUVIMEDEUVIMED entdecken
Open Access

Associations Between Radiation Oncologist Demographic Factors and Segmentation Similarity Benchmarks: Insights From a Crowd-Sourced Challenge Using Bayesian Estimation

Kareem A Wahid iD, Onur Sahin iD, Suprateek Kundu, Diana Lin, Anthony Alanis iD, Salik Tehami, Serageldin Kamel iD, Simon Duke, Michael V Sherer iD, Mathis Rasmussen iD, Stine Korreman iD, David Fuentes und 9 weitere

JCO Clinical Cancer Informatics · 2024

DOI: 10.1200/cci.23.00174 ↗

Kurz gefasst

Fachartikel in der Zeitschrift JCO Clinical Cancer Informatics, 2024. Verfasst von Kareem A Wahid und 20 weiteren Autor:innen. Beteiligte Einrichtung: Department of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX. Hauptthemen laut MEDLINE: Bayes Theorem, Benchmarking, Radiation Oncologists. Die Arbeit nennt 21 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: NCI NIH HHS, NIDCR NIH HHS, NIBIB NIH HHS.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

PURPOSE The quality of radiotherapy auto-segmentation training data, primarily derived from clinician observers, is of utmost importance. However, the factors influencing the quality of clinician-derived segmentations are poorly understood; our study aims to quantify these factors. METHODS Organ at risk (OAR) and tumor-related segmentations provided by radiation oncologists from the Contouring Collaborative for Consensus in Radiation Oncology data set were used. Segmentations were derived from five disease sites: breast, sarcoma, head and neck (H&N), gynecologic (GYN), and GI. Segmentation quality was determined on a structure-by-structure basis by comparing the observer segmentations with an expert-derived consensus, which served as a reference standard benchmark. The Dice similarity coefficient (DSC) was primarily used as a metric for the comparisons. DSC was stratified into binary groups on the basis of structure-specific expert-derived interobserver variability (IOV) cutoffs. Generalized linear mixed-effects models using Bayesian estimation were used to investigate the association between demographic variables and the binarized DSC for each disease site. Variables with a highest density interval excluding zero were considered to substantially affect the outcome measure. RESULTS Five hundred seventy-four, 110, 452, 112, and 48 segmentations were used for the breast, sarcoma, H&N, GYN, and GI cases, respectively. The median percentage of segmentations that crossed the expert DSC IOV cutoff when stratified by structure type was 55% and 31% for OARs and tumors, respectively. Regression analysis revealed that the structure being tumor-related had a substantial negative impact on binarized DSC for the breast, sarcoma, H&N, and GI cases. There were no recurring relationships between segmentation quality and demographic variables across the cases, with most variables demonstrating large standard deviations. CONCLUSION Our study highlights substantial uncertainty surrounding conventionally presumed factors influencing segmentation quality relative to benchmarks.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Bayes TheoremBenchmarkingRadiation OncologistsHumansFemaleRadiotherapy Planning, Computer-AssistedNeoplasmsOrgans at RiskMaleRadiation OncologyDemographyObserver Variation

Autor:innen und Institutionen

  • Department of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX.
  • Department of Imaging Physics, The University of Texas MD Anderson Cancer Center, Houston, TX.
  • Department of Biostatistics, The University of Texas MD Anderson Cancer Center, Houston, TX.
  • Department of Radiation Oncology, Memorial Sloan Kettering Cancer Center, New York, NY.
  • Department of Radiation Oncology, Cambridge University Hospitals, Cambridge, United Kingdom.
  • Department of Radiation Medicine and Applied Sciences, University of California San Diego, La Jolla, CA.

ORCID-Profile: Kareem A Wahid, Onur Sahin, Anthony Alanis, Serageldin Kamel, Michael V Sherer, Mathis Rasmussen, Stine Korreman, James D Murphy, Abdallah S R Mohamed, Mohammed A Naser, Erin F Gillespie, Clifton D Fuller

Förderung

  • NCI NIH HHS
  • NIDCR NIH HHS
  • NIBIB NIH HHS

Zitieren

APA

Wahid, K. A., Sahin, O., Kundu, S., Lin, D., Alanis, A., Tehami, S., Kamel, S., Duke, S., Sherer, M. V., Rasmussen, M., Korreman, S., Fuentes, D., Cislo, M., Nelms, B. E., Christodouleas, J. P., Murphy, J. D., Mohamed, A. S. R., He, R., Naser, M. A., …, & Fuller, C. D. (2024). Associations Between Radiation Oncologist Demographic Factors and Segmentation Similarity Benchmarks: Insights From a Crowd-Sourced Challenge Using Bayesian Estimation. JCO Clinical Cancer Informatics. https://doi.org/10.1200/cci.23.00174

Vancouver

Wahid KA, Sahin O, Kundu S, Lin D, Alanis A, Tehami S, et al. Associations Between Radiation Oncologist Demographic Factors and Segmentation Similarity Benchmarks: Insights From a Crowd-Sourced Challenge Using Bayesian Estimation. JCO Clinical Cancer Informatics. 2024. doi:10.1200/cci.23.00174

BibTeX
@article{Wahid2024,
  author = {Wahid, Kareem A and Sahin, Onur and Kundu, Suprateek and Lin, Diana and Alanis, Anthony and Tehami, Salik and Kamel, Serageldin and Duke, Simon and Sherer, Michael V and Rasmussen, Mathis and Korreman, Stine and Fuentes, David and Cislo, Michael and Nelms, Benjamin E and Christodouleas, John P and Murphy, James D and Mohamed, Abdallah S R and He, Renjie and Naser, Mohammed A and Gillespie, Erin F and Fuller, Clifton D},
  title = {Associations Between Radiation Oncologist Demographic Factors and Segmentation Similarity Benchmarks: Insights From a Crowd-Sourced Challenge Using Bayesian Estimation},
  journal = {JCO Clinical Cancer Informatics},
  year = {2024},
  doi = {10.1200/cci.23.00174}
}
Kostenlos starten →