Associations Between Radiation Oncologist Demographic Factors and Segmentation Similarity Benchmarks: Insights From a Crowd-Sourced Challenge Using Bayesian Estimation
JCO Clinical Cancer Informatics · 2024
DOI: 10.1200/cci.23.00174 ↗Kurz gefasst
Fachartikel in der Zeitschrift JCO Clinical Cancer Informatics, 2024. Verfasst von Kareem A Wahid und 20 weiteren Autor:innen. Beteiligte Einrichtung: Department of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX. Hauptthemen laut MEDLINE: Bayes Theorem, Benchmarking, Radiation Oncologists. Die Arbeit nennt 21 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: NCI NIH HHS, NIDCR NIH HHS, NIBIB NIH HHS.
Abstract (Originalsprache)
PURPOSE The quality of radiotherapy auto-segmentation training data, primarily derived from clinician observers, is of utmost importance. However, the factors influencing the quality of clinician-derived segmentations are poorly understood; our study aims to quantify these factors. METHODS Organ at risk (OAR) and tumor-related segmentations provided by radiation oncologists from the Contouring Collaborative for Consensus in Radiation Oncology data set were used. Segmentations were derived from five disease sites: breast, sarcoma, head and neck (H&N), gynecologic (GYN), and GI. Segmentation quality was determined on a structure-by-structure basis by comparing the observer segmentations with an expert-derived consensus, which served as a reference standard benchmark. The Dice similarity coefficient (DSC) was primarily used as a metric for the comparisons. DSC was stratified into binary groups on the basis of structure-specific expert-derived interobserver variability (IOV) cutoffs. Generalized linear mixed-effects models using Bayesian estimation were used to investigate the association between demographic variables and the binarized DSC for each disease site. Variables with a highest density interval excluding zero were considered to substantially affect the outcome measure. RESULTS Five hundred seventy-four, 110, 452, 112, and 48 segmentations were used for the breast, sarcoma, H&N, GYN, and GI cases, respectively. The median percentage of segmentations that crossed the expert DSC IOV cutoff when stratified by structure type was 55% and 31% for OARs and tumors, respectively. Regression analysis revealed that the structure being tumor-related had a substantial negative impact on binarized DSC for the breast, sarcoma, H&N, and GI cases. There were no recurring relationships between segmentation quality and demographic variables across the cases, with most variables demonstrating large standard deviations. CONCLUSION Our study highlights substantial uncertainty surrounding conventionally presumed factors influencing segmentation quality relative to benchmarks.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Department of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX.
- Department of Imaging Physics, The University of Texas MD Anderson Cancer Center, Houston, TX.
- Department of Biostatistics, The University of Texas MD Anderson Cancer Center, Houston, TX.
- Department of Radiation Oncology, Memorial Sloan Kettering Cancer Center, New York, NY.
- Department of Radiation Oncology, Cambridge University Hospitals, Cambridge, United Kingdom.
- Department of Radiation Medicine and Applied Sciences, University of California San Diego, La Jolla, CA.
ORCID-Profile: Kareem A Wahid, Onur Sahin, Anthony Alanis, Serageldin Kamel, Michael V Sherer, Mathis Rasmussen, Stine Korreman, James D Murphy, Abdallah S R Mohamed, Mohammed A Naser, Erin F Gillespie, Clifton D Fuller
Förderung
- NCI NIH HHS
- NIDCR NIH HHS
- NIBIB NIH HHS
Zitieren
APA
Wahid, K. A., Sahin, O., Kundu, S., Lin, D., Alanis, A., Tehami, S., Kamel, S., Duke, S., Sherer, M. V., Rasmussen, M., Korreman, S., Fuentes, D., Cislo, M., Nelms, B. E., Christodouleas, J. P., Murphy, J. D., Mohamed, A. S. R., He, R., Naser, M. A., …, & Fuller, C. D. (2024). Associations Between Radiation Oncologist Demographic Factors and Segmentation Similarity Benchmarks: Insights From a Crowd-Sourced Challenge Using Bayesian Estimation. JCO Clinical Cancer Informatics. https://doi.org/10.1200/cci.23.00174
Vancouver
Wahid KA, Sahin O, Kundu S, Lin D, Alanis A, Tehami S, et al. Associations Between Radiation Oncologist Demographic Factors and Segmentation Similarity Benchmarks: Insights From a Crowd-Sourced Challenge Using Bayesian Estimation. JCO Clinical Cancer Informatics. 2024. doi:10.1200/cci.23.00174
BibTeX
@article{Wahid2024,
author = {Wahid, Kareem A and Sahin, Onur and Kundu, Suprateek and Lin, Diana and Alanis, Anthony and Tehami, Salik and Kamel, Serageldin and Duke, Simon and Sherer, Michael V and Rasmussen, Mathis and Korreman, Stine and Fuentes, David and Cislo, Michael and Nelms, Benjamin E and Christodouleas, John P and Murphy, James D and Mohamed, Abdallah S R and He, Renjie and Naser, Mohammed A and Gillespie, Erin F and Fuller, Clifton D},
title = {Associations Between Radiation Oncologist Demographic Factors and Segmentation Similarity Benchmarks: Insights From a Crowd-Sourced Challenge Using Bayesian Estimation},
journal = {JCO Clinical Cancer Informatics},
year = {2024},
doi = {10.1200/cci.23.00174}
}
EUVIMED