Exploring ChatGPT effectiveness in addressing direct patient queries on colorectal cancer screening
Endoscopy International Open · 12.05.2025 · 13 (CP)
DOI: 10.1055/a-2568-9416 ↗Kurz gefasst
Fachartikel in der Zeitschrift Endoscopy International Open, erschienen am 12.05.2025. Verfasst von Marcello Maida und 6 weiteren Autor:innen. Beteiligte Einrichtung: Department of Medicine and Surgery, Kore University of Enna, Enna, Italy. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 11 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Recent studies showed that large language models (LLMs) could enhance understanding of colorectal cancer (CRC) screening, potentially increasing participation rates. However, a limitation of these studies is that questions posed to LLMs are generated by experts. This study aimed to investigate ChatGPT-4o effectiveness in answering CRC screening queries directly generated by patients. Ten consecutive subjects aged 50 to 69 years who were eligible for the Italian national CRC screening program but not actively involved were enrolled. Four possible scenarios for CRC screening were presented to each participant and they were asked to formulate one question per scenario to gather additional information. These questions were then posed to ChatGPT in two separate sessions. The responses were evaluated by five senior experts, who rated each answer based on three criteria: accuracy, completeness, and comprehensibility, using a 5-point Likert scale. In addition, the same 10 patients who created the questions assessed the answers, rating each response as complete, understandable, and trustworthy on a dichotomous scale (yes/no). Experts rated the responses with mean scores of 4.1 ± 1.0 for accuracy, 4.2 ± 1.0 for completeness, and 4.3 ± 1.0 for comprehensibility. Patients rated responses as complete in 97.5%, understandable in 95%, and trustworthy in 100% of cases. Consistency over time was confirmed by an 86.8% similarity between session responses. Despite variability in questions and answers, ChatGPT confirmed good performances in answering CRC screening queries, even when used directly by patients.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Medicine and Surgery, Kore University of Enna, Enna, Italy.
- Gastroenterology Unit, Umberto I Hospital, Enna, Italy.
- Institute of Health and Society, University of Oslo, Oslo, Norway.
- Digestive Disease Center, Showa University Northern Yokohama Hospital, Yokohama, Japan.
- Department of Medical and Surgical Sciences, IRCCS University Hospital of Bologna Sant Orsola Polyclinic, Bologna, Italy.
- Department of Medical and Surgical Sciences, University of Bologna, Bologna, Italy.
ORCID-Profile: Marcello Maida, Yuichi Mori, Antonio Facciorusso, Cesare Hassan
Zitieren
APA
Maida, M., Mori, Y., Fuccio, L., Sferrazza, S., Vitello, A., Facciorusso, A., & Hassan, C. (2025). Exploring ChatGPT effectiveness in addressing direct patient queries on colorectal cancer screening. Endoscopy International Open, 13(CP). https://doi.org/10.1055/a-2568-9416
Vancouver
Maida M, Mori Y, Fuccio L, Sferrazza S, Vitello A, Facciorusso A, et al. Exploring ChatGPT effectiveness in addressing direct patient queries on colorectal cancer screening. Endoscopy International Open. 2025;13(CP). doi:10.1055/a-2568-9416
BibTeX
@article{Maida2025,
author = {Maida, Marcello and Mori, Yuichi and Fuccio, Lorenzo and Sferrazza, Sandro and Vitello, Alessandro and Facciorusso, Antonio and Hassan, Cesare},
title = {Exploring ChatGPT effectiveness in addressing direct patient queries on colorectal cancer screening},
journal = {Endoscopy International Open},
year = {2025},
volume = {13},
number = {CP},
doi = {10.1055/a-2568-9416}
}
EUVIMED