Assessing ChatGPT for Clinical Decision-Making in Radiation Oncology, With Open-Ended Questions and Images
Practical Radiation Oncology · 2025
DOI: 10.1016/j.prro.2025.04.009 ↗Kurz gefasst
Fachartikel in der Zeitschrift Practical Radiation Oncology, 2025. Verfasst von Wei-Kai Chuang und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Radiation Oncology, Shuang Ho Hospital, Taipei Medical University, New Taipei City, Taiwan; Department of Biomedical Imaging and Radiol…. Hauptthemen laut MEDLINE: Radiation Oncology, Clinical Decision-Making, Nasopharyngeal Neoplasms, Nasopharyngeal Carcinoma. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 52 Literaturangaben.
Abstract (Originalsprache)
PURPOSE: This study assesses the practicality and correctness of Chat Generative Pre-trained Transformer (ChatGPT)-4 and 4O's answers to clinical inquiries in radiation oncology, and evaluates ChatGPT-4O for staging nasopharyngeal carcinoma (NPC) cases with magnetic resonance (MR) images. METHODS AND MATERIALS: A total of 164 open-ended questions covering representative professional domains (Clinical_G: knowledge on standardized guidelines; Clinical_C: complex clinical scenarios; Nursing: nursing and health education; and Technology: radiation technology and dosimetry) were prospectively formulated by experts and presented to ChatGPT-4 and 4O. Each ChatGPT's answer was graded as 1 (Directly practical for clinical decision-making), 2 (Correct but inadequate), 3 (Mixed with correct and incorrect information), or 4 (Completely incorrect). ChatGPT-4O was presented with the representative diagnostic MR images of 20 patients with NPC across different T stages, and asked to determine the T stage of each case. RESULTS: The proportions of ChatGPT's answers that were practical (grade 1) varied across professional domains (P < .01), higher in Nursing (GPT-4: 91.9%; GPT-4O: 94.6%) and Clinical_G (GPT-4: 82.2%; GPT-4O: 88.9%) domains than in Clinical_C (GPT-4: 54.1%; GPT-4O: 62.2%) and Technology (GPT-4: 64.4%; GPT-4O: 77.8%) domains. The proportions of correct (grade 1+2) answers (GPT-4: 89.6%; GPT-4O: 98.8%; P < .01) were universally high across all professional domains. However, ChatGPT-4O failed to stage NPC cases via MR images, indiscriminately assigning T4 to all actually non-T4 cases (κ = 0; 95% CI, -0.253 to 0.253). CONCLUSIONS: ChatGPT could be a safe clinical decision-support tool in radiation oncology, because it correctly answered the vast majority of clinical inquiries across professional domains. However, its clinical practicality should be cautiously weighted particularly in the Clinical_C and Technology domains. ChatGPT-4O is not yet mature to interpret diagnostic images for cancer staging.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Department of Radiation Oncology, Shuang Ho Hospital, Taipei Medical University, New Taipei City, Taiwan; Department of Biomedical Imaging and Radiological Sciences, National Yang Ming Chiao Tung University, Taipei, Tai…
- Department of Radiation Oncology, Taoyuan General Hospital, Ministry of Health and Welfare, Taoyuan, Taiwan.
- Division of Radiation Oncology, Department of Oncology, National Taiwan University Hospital Yunlin Branch, Yunlin County, Taiwan; Department of Biomedical Engineering, National Taiwan University, Taipei, Taiwan; Divisio…
- Department of Radiation Oncology, Taoyuan General Hospital, Ministry of Health and Welfare, Taoyuan, Taiwan; Department of Biomedical Engineering, National Yang Ming Chiao Tung University, Taipei, Taiwan; Institute of B…
Zitieren
APA
Chuang, W. K., Kao, Y. S., Liu, Y. T., & Lee, C. Y. (2025). Assessing ChatGPT for Clinical Decision-Making in Radiation Oncology, With Open-Ended Questions and Images. Practical Radiation Oncology. https://doi.org/10.1016/j.prro.2025.04.009
Vancouver
Chuang WK, Kao YS, Liu YT, Lee CY. Assessing ChatGPT for Clinical Decision-Making in Radiation Oncology, With Open-Ended Questions and Images. Practical Radiation Oncology. 2025. doi:10.1016/j.prro.2025.04.009
BibTeX
@article{Chuang2025,
author = {Chuang, Wei-Kai and Kao, Yung-Shuo and Liu, Yen-Ting and Lee, Cho-Yin},
title = {Assessing ChatGPT for Clinical Decision-Making in Radiation Oncology, With Open-Ended Questions and Images},
journal = {Practical Radiation Oncology},
year = {2025},
doi = {10.1016/j.prro.2025.04.009}
}
EUVIMED