Evaluating the capability of ChatGPT in predicting drug–drug interactions: Real‐world evidence using hospitalized patient data
British Journal of Clinical Pharmacology · 2024
DOI: 10.1111/bcp.16275 ↗Kurz gefasst
Fachartikel in der Zeitschrift British Journal of Clinical Pharmacology, 2024. Verfasst von Ramya Padmavathy Radha Krishnan und 10 weiteren Autor:innen. Beteiligte Einrichtung: Faculty of Medicine and Health, University of Sydney, Sydney, New South Wales, Australia. Hauptthemen laut MEDLINE: Drug Interactions. Die Arbeit wurde bisher 30-mal zitiert (Crossref) und nennt 27 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).
Abstract (Originalsprache)
Drug–drug interactions (DDIs) present a significant health burden, compounded by clinician time constraints and poor patient health literacy. We assessed the ability of ChatGPT (generative artificial intelligence‐based large language model) to predict DDIs in a real‐world setting. Demographics, diagnoses and prescribed medicines for 120 hospitalized patients were input through three standardized prompts to ChatGPT version 3.5 and compared against pharmacist DDI evaluation to estimate diagnostic accuracy. Area under receiver operating characteristic and inter‐rater reliability (Cohen's and Fleiss' kappa coefficients) were calculated. ChatGPT's responses differed based on prompt wording style, with higher sensitivity for prompts mentioning ‘drug interaction’. Confusion matrices displayed low true positive and high true negative rates, and there was minimal agreement between ChatGPT and pharmacists (Cohen's kappa values 0.077–0.143). Low sensitivity values suggest a lack of success in identifying DDIs by ChatGPT, and further development is required before it can reliably assess potential DDIs in real‐world scenarios.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Faculty of Medicine and Health, University of Sydney, Sydney, New South Wales, Australia.
- Faculty of Science, University of Sydney, Sydney, New South Wales, Australia.
ORCID-Profile: Ramya Padmavathy Radha Krishnan
Zitieren
APA
Radha Krishnan, R. P., Hung, E. H., Ashford, M., Edillo, C. E., Gardner, C., Hatrick, H. B., Kim, B., Lai, A. W. Y., Li, X., Zhao, Y. X., & Raubenheimer, J. E. (2024). Evaluating the capability of ChatGPT in predicting drug–drug interactions: Real‐world evidence using hospitalized patient data. British Journal of Clinical Pharmacology. https://doi.org/10.1111/bcp.16275
Vancouver
Radha Krishnan RP, Hung EH, Ashford M, Edillo CE, Gardner C, Hatrick HB, et al. Evaluating the capability of ChatGPT in predicting drug–drug interactions: Real‐world evidence using hospitalized patient data. British Journal of Clinical Pharmacology. 2024. doi:10.1111/bcp.16275
BibTeX
@article{RadhaKrishnan2024,
author = {Radha Krishnan, Ramya Padmavathy and Hung, Euniss Hinyo and Ashford, Megan and Edillo, Clark Ethan and Gardner, Charlise and Hatrick, Hector Blake and Kim, Byungjun and Lai, Angel Wing Yan and Li, Xinran and Zhao, Yvonne Xinyi and Raubenheimer, Jacques Eugene},
title = {Evaluating the capability of ChatGPT in predicting drug–drug interactions: Real‐world evidence using hospitalized patient data},
journal = {British Journal of Clinical Pharmacology},
year = {2024},
doi = {10.1111/bcp.16275}
}
EUVIMED