EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Evaluating the capability of ChatGPT in predicting drug–drug interactions: Real‐world evidence using hospitalized patient data

Ramya Padmavathy Radha Krishnan iD, Euniss Hinyo Hung, Megan Ashford, Clark Ethan Edillo, Charlise Gardner, Hector Blake Hatrick, Byungjun Kim, Angel Wing Yan Lai, Xinran Li, Yvonne Xinyi Zhao, Jacques Eugene Raubenheimer

British Journal of Clinical Pharmacology · 2024

DOI: 10.1111/bcp.16275 ↗

Kurz gefasst

Fachartikel in der Zeitschrift British Journal of Clinical Pharmacology, 2024. Verfasst von Ramya Padmavathy Radha Krishnan und 10 weiteren Autor:innen. Beteiligte Einrichtung: Faculty of Medicine and Health, University of Sydney, Sydney, New South Wales, Australia. Hauptthemen laut MEDLINE: Drug Interactions. Die Arbeit wurde bisher 30-mal zitiert (Crossref) und nennt 27 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Drug–drug interactions (DDIs) present a significant health burden, compounded by clinician time constraints and poor patient health literacy. We assessed the ability of ChatGPT (generative artificial intelligence‐based large language model) to predict DDIs in a real‐world setting. Demographics, diagnoses and prescribed medicines for 120 hospitalized patients were input through three standardized prompts to ChatGPT version 3.5 and compared against pharmacist DDI evaluation to estimate diagnostic accuracy. Area under receiver operating characteristic and inter‐rater reliability (Cohen's and Fleiss' kappa coefficients) were calculated. ChatGPT's responses differed based on prompt wording style, with higher sensitivity for prompts mentioning ‘drug interaction’. Confusion matrices displayed low true positive and high true negative rates, and there was minimal agreement between ChatGPT and pharmacists (Cohen's kappa values 0.077–0.143). Low sensitivity values suggest a lack of success in identifying DDIs by ChatGPT, and further development is required before it can reliably assess potential DDIs in real‐world scenarios.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Drug InteractionsHumansMaleFemaleMiddle AgedAgedArtificial IntelligenceHospitalizationReproducibility of ResultsAdultPharmacistsAged, 80 and overROC Curve

Stichwörter der Autor:innen

ChatGPTartificial intelligence (AI)drug–drug interaction (DDI)large language model (LLM)patient health literacy

Autor:innen und Institutionen

  • Faculty of Medicine and Health, University of Sydney, Sydney, New South Wales, Australia.
  • Faculty of Science, University of Sydney, Sydney, New South Wales, Australia.

ORCID-Profile: Ramya Padmavathy Radha Krishnan

Zitieren

APA

Radha Krishnan, R. P., Hung, E. H., Ashford, M., Edillo, C. E., Gardner, C., Hatrick, H. B., Kim, B., Lai, A. W. Y., Li, X., Zhao, Y. X., & Raubenheimer, J. E. (2024). Evaluating the capability of ChatGPT in predicting drug–drug interactions: Real‐world evidence using hospitalized patient data. British Journal of Clinical Pharmacology. https://doi.org/10.1111/bcp.16275

Vancouver

Radha Krishnan RP, Hung EH, Ashford M, Edillo CE, Gardner C, Hatrick HB, et al. Evaluating the capability of ChatGPT in predicting drug–drug interactions: Real‐world evidence using hospitalized patient data. British Journal of Clinical Pharmacology. 2024. doi:10.1111/bcp.16275

BibTeX
@article{RadhaKrishnan2024,
  author = {Radha Krishnan, Ramya Padmavathy and Hung, Euniss Hinyo and Ashford, Megan and Edillo, Clark Ethan and Gardner, Charlise and Hatrick, Hector Blake and Kim, Byungjun and Lai, Angel Wing Yan and Li, Xinran and Zhao, Yvonne Xinyi and Raubenheimer, Jacques Eugene},
  title = {Evaluating the capability of ChatGPT in predicting drug–drug interactions: Real‐world evidence using hospitalized patient data},
  journal = {British Journal of Clinical Pharmacology},
  year = {2024},
  doi = {10.1111/bcp.16275}
}
Kostenlos starten →