Large Language Models as Decision-Making Tools in Oncology: Comparing Artificial Intelligence Suggestions and Expert Recommendations
JCO Clinical Cancer Informatics · 2025-03 · (9)
DOI: 10.1200/cci-24-00230 ↗Kurz gefasst
Vergleichsstudie in der Zeitschrift JCO Clinical Cancer Informatics, 2025-03. Verfasst von Loic Ah-Thiane und 11 weiteren Autor:innen. Beteiligte Einrichtung: Department of Radiotherapy, ICO Rene Gauducheau, Saint-Herblain, France. Hauptthemen laut MEDLINE: Artificial Intelligence, Breast Neoplasms, Medical Oncology, Clinical Decision-Making. Die Arbeit wurde bisher 27-mal zitiert (Crossref) und nennt 16 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
PURPOSE To determine the accuracy of large language models (LLMs) in generating appropriate treatment options for patients with early breast cancer on the basis of their medical records. MATERIALS AND METHODS Retrospective study using anonymized medical records of patients with BC presented during multidisciplinary team meetings (MDTs) between January and April 2024. Three generalist artificial intelligence models (Claude3-Opus, GPT4-Turbo, and LLaMa3-70B) were used to generate treatment suggestions, which were compared with experts' decisions. The primary outcome was the rate of appropriate suggestions from the LLMs, compared with the reference experts' decisions. The secondary outcome was the LLMs' performances (F1 score and specificity) in generating appropriate suggestions for each treatment category. RESULTS The rates of appropriate suggestions were 86.6% (97/112), 85.7% (96/112), and 75.0% (84/112) for Claude3-Opus, GPT4-Turbo, and LLaMa3-70B, respectively. No significant difference was found between Claude3-Opus and GPT4-Turbo ( P = .85), but both tended to perform better than LLaMa3-70B ( P = .027 and P = .043, respectively). LLMs showed high accuracy for adjuvant endocrine therapy and targeted therapy indications. However, they tended to overestimate the need for adjuvant radiotherapy and had variable performances in suggesting adjuvant chemotherapy and genomic tests. CONCLUSION LLMs, particularly Claude3-Opus and GPT4-Turbo, demonstrated promising accuracy in suggesting appropriate adjuvant treatments for patients with early BC on the basis of their medical records. Although LLMs showed limitations in validating surgery and indicating genomic tests, their performance in other treatment modalities highlights their potential to automate and augment decision making during MDTs. Further studies with fine-tuned LLMs and a prospective design are needed to demonstrate their utility in clinical practice.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Department of Radiotherapy, ICO Rene Gauducheau, Saint-Herblain, France.
- Department of Medical Oncology, Center Léon Bérard, Lyon, France.
- Department of Medical Oncology, ICO Rene Gauducheau, Saint-Herblain, France.
- Department of Surgical Oncology, ICO Rene Gauducheau, Saint-Herblain, France.
- Department of Nuclear Medicine, ICO Rene Gauducheau, Saint-Herblain, France.
ORCID-Profile: Loic Ah-Thiane, Pierre-Etienne Heudel, Caroline Rousseau, Stéphane Supiot, Tanguy Perennec, Jean-Sébastien Frenel
Zitieren
APA
Ah-Thiane, L., Heudel, P. E., Campone, M., Robert, M., Brillaud-Meflah, V., Rousseau, C., Le Blanc-Onfroy, M., Tomaszewski, F., Supiot, S., Perennec, T., Mervoyer, A., & Frenel, J. S. (2025). Large Language Models as Decision-Making Tools in Oncology: Comparing Artificial Intelligence Suggestions and Expert Recommendations. JCO Clinical Cancer Informatics. https://doi.org/10.1200/cci-24-00230
Vancouver
Ah-Thiane L, Heudel PE, Campone M, Robert M, Brillaud-Meflah V, Rousseau C, et al. Large Language Models as Decision-Making Tools in Oncology: Comparing Artificial Intelligence Suggestions and Expert Recommendations. JCO Clinical Cancer Informatics. 2025. doi:10.1200/cci-24-00230
BibTeX
@article{AhThiane2025,
author = {Ah-Thiane, Loic and Heudel, Pierre-Etienne and Campone, Mario and Robert, Marie and Brillaud-Meflah, Victoire and Rousseau, Caroline and Le Blanc-Onfroy, Magali and Tomaszewski, Florine and Supiot, Stéphane and Perennec, Tanguy and Mervoyer, Augustin and Frenel, Jean-Sébastien},
title = {Large Language Models as Decision-Making Tools in Oncology: Comparing Artificial Intelligence Suggestions and Expert Recommendations},
journal = {JCO Clinical Cancer Informatics},
year = {2025},
number = {9},
doi = {10.1200/cci-24-00230}
}
EUVIMED