EUVIMEDEUVIMED entdecken
Crossref

Evaluating the performance of ChatGPT in clinical pharmacy: A comparative study of ChatGPT and clinical pharmacists

Xiaoru Huang, Dannya Estau, Xuening Liu, Yang Yu, Jiguang Qin, Zijian Li iD

British Journal of Clinical Pharmacology · 2024-01 · 90 (1) · 232-238

DOI: 10.1111/bcp.15896 ↗

Kurz gefasst

Fachartikel in der Zeitschrift British Journal of Clinical Pharmacology, online erschienen am 13.09.2023. Verfasst von Xiaoru Huang und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Pharmacy, Peking University Third Hospital, Beijing, China. Hauptthemen laut MEDLINE: Drug-Related Side Effects and Adverse Reactions, Pharmacy Service, Hospital, Pharmacy. Die Arbeit wurde bisher 110-mal zitiert (Crossref) und nennt 40 Literaturangaben. Gefördert von: Beijing Municipal Natural Science Foundation, Medical Research Management/Basic and Clinical Research Unit of Metabolic Cardiovascular Diseases, Chinese Academy of Medical Sciences, National Key Research and Development Program of China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Aims

To evaluate the performance of chat generative pretrained transformer (ChatGPT) in key domains of clinical pharmacy practice, including prescription review, patient medication education, adverse drug reaction (ADR) recognition, ADR causality assessment and drug counselling.

Methods

Questions and clinical pharmacist's answers were collected from real clinical cases and clinical pharmacist competency assessment. ChatGPT's responses were generated by inputting the same question into the ‘New Chat’ box of ChatGPT Mar 23 Version. Five licensed clinical pharmacists independently rated these answers on a scale of 0 ( Completely incorrect ) to 10 ( Completely correct ). The mean scores of ChatGPT and clinical pharmacists were compared using a paired 2‐tailed Student's t ‐test. The text content of the answers was also descriptively summarized together.

Results

The quantitative results indicated that ChatGPT was excellent in drug counselling (ChatGPT: 8.77 vs . clinical pharmacist: 9.50, P = .0791) and weak in prescription review (5.23 vs . 9.90, P = .0089), patient medication education (6.20 vs . 9.07, P = .0032), ADR recognition (5.07 vs . 9.70, P = .0483) and ADR causality assessment (4.03 vs . 9.73, P = .023). The capabilities and limitations of ChatGPT in clinical pharmacy practice were summarized based on the completeness and accuracy of the answers. ChatGPT revealed robust retrieval, information integration and dialogue capabilities. It lacked medicine‐specific datasets as well as the ability for handling advanced reasoning and complex instructions.

Conclusions

While ChatGPT holds promise in clinical pharmacy practice as a supplementary tool, the ability of ChatGPT to handle complex problems needs further improvement and refinement.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Drug-Related Side Effects and Adverse ReactionsPharmacy Service, HospitalPharmacyHumansPharmacistsClinical Competence

Stichwörter der Autor:innen

ChatGPTclinical pharmacy

Autor:innen und Institutionen

  • Department of Pharmacy, Peking University Third Hospital, Beijing, China.
  • Department of Pharmaceutical Management and Clinical Pharmacy, College of Pharmacy, Peking University, Beijing, China.
  • Department of Cardiology and Institute of Vascular Medicine, Peking University Third Hospital, Beijing Key Laboratory of Cardiovascular Receptors Research, Key Laboratory of Cardiovascular Molecular Biology and Regulato…

ORCID-Profile: Zijian Li

Förderung

  • Beijing Municipal Natural Science Foundation
  • Medical Research Management/Basic and Clinical Research Unit of Metabolic Cardiovascular Diseases, Chinese Academy of Medical Sciences
  • National Key Research and Development Program of China
  • National Natural Science Foundation of China

Zitieren

APA

Huang, X., Estau, D., Liu, X., Yu, Y., Qin, J., & Li, Z. (2024). Evaluating the performance of ChatGPT in clinical pharmacy: A comparative study of ChatGPT and clinical pharmacists. British Journal of Clinical Pharmacology, 90(1), 232-238. https://doi.org/10.1111/bcp.15896

Vancouver

Huang X, Estau D, Liu X, Yu Y, Qin J, Li Z. Evaluating the performance of ChatGPT in clinical pharmacy: A comparative study of ChatGPT and clinical pharmacists. British Journal of Clinical Pharmacology. 2024;90(1):232-238. doi:10.1111/bcp.15896

BibTeX
@article{Huang2024,
  author = {Huang, Xiaoru and Estau, Dannya and Liu, Xuening and Yu, Yang and Qin, Jiguang and Li, Zijian},
  title = {Evaluating the performance of ChatGPT in clinical pharmacy: A comparative study of ChatGPT and clinical pharmacists},
  journal = {British Journal of Clinical Pharmacology},
  year = {2024},
  volume = {90},
  number = {1},
  pages = {232--238},
  doi = {10.1111/bcp.15896}
}
Kostenlos starten →