Physician Perspectives on ChatGPT-4o as a Patient Resource for Abdominal Cancer Surgeries: Cross-Sectional Survey
JMIR Perioperative Medicine · 04.05.2026 · 9 · e81374-e81374
DOI: 10.2196/81374 ↗Kurz gefasst
Querschnittstudie in der Zeitschrift JMIR Perioperative Medicine, online erschienen am 04.05.2026. Verfasst von Christina V Lindsay und 7 weiteren Autor:innen. Beteiligte Einrichtung: School of Medicine, Duke University, 8 Searle Center Dr, Durham, NC, 27710, United States, 1 305-439-7523. Hauptthemen laut MEDLINE: Attitude of Health Personnel, Physicians. Die Arbeit nennt 38 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Background
Artificial intelligence (AI) models are being increasingly integrated into clinical care. Moreover, the availability of publicly accessible AI resources makes them attractive to patients seeking clinical information. Little is known regarding the use of large language models as patient resources for navigating major cancer diagnoses.
Objective
This study aimed to evaluate the content, readability, and safety of ChatGPT (OpenAI; GPT-4o)-generated responses to common perioperative queries about hepatic, pancreatic, and colon cancers.
Methods
A 28-question survey was developed based on frequently asked surgical questions for select malignancies. Surgical oncologists rated ChatGPT-4o-generated responses on a 5-point Likert scale for accuracy, quality, and tangibility. Readability was assessed using the Flesch-Kincaid Reading Grade Level (FKRGL) and Flesch Reading Ease (FRE). Respondents provided free-text comments and reported their comfort with patients using ChatGPT. Survey completion implied consent.
Results
A total of 7 attending surgical oncologists with a median of 7 (IQR 4-13) years in practice completed the survey. Responses received mean scores of 3.5/5 (SD 0.28) for quality, 3.6/5 (SD 0.34) for accuracy, and 3.6/5 (SD 0.29) for tangibility. The responses had a median FKRGL score of 14.6 (IQR 13.3-15.6) and FRE score of 29.4 (IQR 20.5-36.3). On a post hoc analysis for select questions, the median FKRGL was 15.6 (IQR 14.4-16.7), decreasing to 7.1 (IQR 6.1-8.3) and 14.5 (IQR 13.2-15.4) with prompting and rephrasing, and the median FRE was 18.1 (IQR 14.6-24.7), increasing to 73.8 (IQR 66.6-79.3) and 32.0 (IQR 27.0-37.7) with prompting and rephrasing. Numerous inaccuracies and content gaps were reported, and approximately 43% (3/7) of providers did not report feeling “comfortable” in having patients consult publicly available AI for medical information.
Conclusions
This study provides cautionary, yet optimistic, findings regarding the value of publicly accessible ChatGPT as a patient resource for abdominal malignancies. Providers should be prepared to effectively counsel patients to identify their educational attainment level when using ChatGPT to mitigate readability challenges.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Medicine, Duke University, 8 Searle Center Dr, Durham, NC, 27710, United States, 1 305-439-7523.
- Center for Personalized Health Care, Duke University, Durham, NC, United States.
- Department of Surgery, Duke University, Durham, NC, United States.
- Department of Medicine, Duke University, Durham, NC, United States.
ORCID-Profile: Christina V Lindsay, Devika A Shenoy, Allison N Martin, Christie L Clipper, Kevin N Shah, Michael E Lidsky, Daniel P Nussbaum, Ralph Snyderman
Zitieren
APA
Lindsay, C. V., Shenoy, D. A., Martin, A. N., Clipper, C. L., Shah, K. N., Lidsky, M. E., Nussbaum, D. P., & Snyderman, R. (2026). Physician Perspectives on ChatGPT-4o as a Patient Resource for Abdominal Cancer Surgeries: Cross-Sectional Survey. JMIR Perioperative Medicine, 9, e81374-e81374. https://doi.org/10.2196/81374
Vancouver
Lindsay CV, Shenoy DA, Martin AN, Clipper CL, Shah KN, Lidsky ME, et al. Physician Perspectives on ChatGPT-4o as a Patient Resource for Abdominal Cancer Surgeries: Cross-Sectional Survey. JMIR Perioperative Medicine. 2026;9:e81374-e81374. doi:10.2196/81374
BibTeX
@article{Lindsay2026,
author = {Lindsay, Christina V and Shenoy, Devika A and Martin, Allison N and Clipper, Christie L and Shah, Kevin N and Lidsky, Michael E and Nussbaum, Daniel P and Snyderman, Ralph},
title = {Physician Perspectives on ChatGPT-4o as a Patient Resource for Abdominal Cancer Surgeries: Cross-Sectional Survey},
journal = {JMIR Perioperative Medicine},
year = {2026},
volume = {9},
pages = {e81374--e81374},
doi = {10.2196/81374}
}
EUVIMED