Exploring the role of artificial intelligence, large language models: Comparing patient‐focused information and clinical decision support capabilities to the gynecologic oncology guidelines
International Journal of Gynecology & Obstetrics · 2025-02 · 168 (2) · 419-427
DOI: 10.1002/ijgo.15869 ↗Kurz gefasst
Vergleichsstudie in der Zeitschrift International Journal of Gynecology & Obstetrics, online erschienen am 20.08.2024. Verfasst von Lee Reicher und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Gynecologic Oncology, Lis Hospital for Women, Tel Aviv Medical Center, Tel Aviv, Israel. Hauptthemen laut MEDLINE: Artificial Intelligence, Genital Neoplasms, Female, Decision Support Systems, Clinical. Die Arbeit wurde bisher 40-mal zitiert (Crossref) und nennt 18 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Gynecologic cancer requires personalized care to improve outcomes. Large language models (LLMs) hold the potential to provide intelligent question‐answering with reliable information about medical queries in clear and plain English, which can be understood by both healthcare providers and patients. We aimed to evaluate two freely available LLMs (ChatGPT and Google's Bard) in answering questions regarding the management of gynecologic cancer. The LLMs' performances were evaluated by developing a set questions that addressed common gynecologic oncologic findings from a patient's perspective and more complex questions to elicit recommendations from a clinician's perspective. Each question was presented to the LLM interface, and the responses generated by the artificial intelligence (AI) model were recorded. The responses were assessed based on the adherence to the National Comprehensive Cancer Network and European Society of Gynecological Oncology guidelines. This evaluation aimed to determine the accuracy and appropriateness of the information provided by LLMs. We showed that the models provided largely appropriate responses to questions regarding common cervical cancer screening tests and BRCA ‐related questions. Less useful answers were received to complex and controversial gynecologic oncology cases, as assessed by reviewing the common guidelines. ChatGPT and Bard lacked knowledge of regional guideline variations, However, it provided practical and multifaceted advice to patients and caregivers regarding the next steps of management and follow up. We conclude that LLMs may have a role as an adjunct informational tool to improve outcomes.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Gynecologic Oncology, Lis Hospital for Women, Tel Aviv Medical Center, Tel Aviv, Israel.
- Sackler School of Medicine, Department of Gynecology, Tel Aviv University, Tel Aviv, Israel.
- Department of Molecular Cell Biology, Weizmann Institute of Science, Rehovot, Israel.
- Department of Computer Science and Applied Mathematics, Weizmann Institute of Science, Rehovot, Israel.
ORCID-Profile: Ido Laskov
Zitieren
APA
Reicher, L., Lutsker, G., Michaan, N., Grisaru, D., & Laskov, I. (2025). Exploring the role of artificial intelligence, large language models: Comparing patient‐focused information and clinical decision support capabilities to the gynecologic oncology guidelines. International Journal of Gynecology & Obstetrics, 168(2), 419-427. https://doi.org/10.1002/ijgo.15869
Vancouver
Reicher L, Lutsker G, Michaan N, Grisaru D, Laskov I. Exploring the role of artificial intelligence, large language models: Comparing patient‐focused information and clinical decision support capabilities to the gynecologic oncology guidelines. International Journal of Gynecology & Obstetrics. 2025;168(2):419-427. doi:10.1002/ijgo.15869
BibTeX
@article{Reicher2025,
author = {Reicher, Lee and Lutsker, Guy and Michaan, Nadav and Grisaru, Dan and Laskov, Ido},
title = {Exploring the role of artificial intelligence, large language models: Comparing patient‐focused information and clinical decision support capabilities to the gynecologic oncology guidelines},
journal = {International Journal of Gynecology & Obstetrics},
year = {2025},
volume = {168},
number = {2},
pages = {419--427},
doi = {10.1002/ijgo.15869}
}
EUVIMED