Conducting Medication Reviews: A Comparative Study Between ChatGPT ‐4 and Healthcare Professionals
Journal of the American Geriatrics Society · 2026-05 · 74 (5) · 1378-1385
DOI: 10.1111/jgs.70415 ↗Kurz gefasst
Vergleichsstudie in der Zeitschrift Journal of the American Geriatrics Society, online erschienen am 12.04.2026. Verfasst von Simone M K Ten Hoope und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Clinical Pharmacy, OLVG Hospital, Amsterdam, the Netherlands. Hauptthemen laut MEDLINE: Polypharmacy, Health Personnel. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 11 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
Background
The increasing prevalence of patients with hyperpolypharmacy (> 10 medications) has made medication reviews increasingly complex. ChatGPT‐4‐Turbo (ChatGPT), a large language model, has demonstrated potential in healthcare applications and could potentially support medication reviews.
Objectives
This study aimed to evaluate the agreement between medication reviews conducted by ChatGPT compared to healthcare professionals (HCPs) in older people. Secondary objectives included: the validity of additional interventions detected by ChatGPT, its ability to structure diagnoses to medication use, and laboratory target values based on patient characteristics.
Methods
In this retrospective proof‐of‐concept study, 51 medication reviews previously conducted by a geriatric internist and hospital pharmacist were re‐evaluated using ChatGPT. ChatGPT was trained on polypharmacy guidelines, was then provided with the same primary data as HCPs, and was asked to perform medication reviews. Two pharmacists scored the agreement between ChatGPT and HCPs. The structuring of information and additional interventions suggested by ChatGPT were reviewed within an expert team. Descriptive statistics were used. Outcomes The primary outcome was the percentage agreement between the interventions suggested by ChatGPT compared to HCPs. Secondary outcomes included the proportion of valid and incorrect interventions suggested by ChatGPT and its ability to structure patient information.
Results
HCPs suggested 183 interventions and ChatGPT 202 interventions. ChatGPT achieved a 27.7% agreement with interventions of HCPs. It identified 19 additional valid interventions which HCPs missed (7.6%), but also proposed 84 incorrect interventions (33.7%). While ChatGPT demonstrated strong capability in structuring patient data (86.4% correct diagnoses linked to medication), it struggled with contextualizing appropriate laboratory target values based on patient characteristics (46.7%).
Conclusion
ChatGPT had low agreement with HCPs, but found additional interventions that HCPs missed. ChatGPT lacks clinical decision‐making capabilities based on individual patient contexts in older people. ChatGPT may, however, serve as a support tool to structure diagnoses and medication lists.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Clinical Pharmacy, OLVG Hospital, Amsterdam, the Netherlands.
- Department of Internal Medicine, OLVG Hospital, Amsterdam, the Netherlands.
- Division of Pharmacoepidemiology and Clinical Pharmacology, Utrecht Institute for Pharmaceutical Sciences, Utrecht University, Utrecht, the Netherlands.
- Research Group Innovations of Pharmaceutical Care, Utrecht University of Applied Sciences, Utrecht, the Netherlands.
- Department of Clinical Pharmacy & Toxicology, Maastricht University Medical Center+, Maastricht, the Netherlands.
- Department of Clinical Pharmacy, CARIM, Cardiovascular Research Institute Maastricht, Maastricht University, Maastricht, the Netherlands.
ORCID-Profile: Simone M K Ten Hoope, Fatma Karapinar-Çarkit
Zitieren
APA
Ten Hoope, S. M. K., Marongiu, S., Siegert, C. E. H., Heerdink, E. R., Janssen, M. J. A., & Karapinar-Çarkit, F. (2026). Conducting Medication Reviews: A Comparative Study Between ChatGPT ‐4 and Healthcare Professionals. Journal of the American Geriatrics Society, 74(5), 1378-1385. https://doi.org/10.1111/jgs.70415
Vancouver
Ten Hoope SMK, Marongiu S, Siegert CEH, Heerdink ER, Janssen MJA, Karapinar-Çarkit F. Conducting Medication Reviews: A Comparative Study Between ChatGPT ‐4 and Healthcare Professionals. Journal of the American Geriatrics Society. 2026;74(5):1378-1385. doi:10.1111/jgs.70415
BibTeX
@article{TenHoope2026,
author = {Ten Hoope, Simone M K and Marongiu, Sabrina and Siegert, Carl E H and Heerdink, Eibert R and Janssen, Marjo J A and Karapinar-Çarkit, Fatma},
title = {Conducting Medication Reviews: A Comparative Study Between ChatGPT ‐4 and Healthcare Professionals},
journal = {Journal of the American Geriatrics Society},
year = {2026},
volume = {74},
number = {5},
pages = {1378--1385},
doi = {10.1111/jgs.70415}
}
EUVIMED