Assessment of Stage Two Hypertension Treatment Plans Written by Generative AI
Journal of Clinical Medicine · 18.04.2026 · 15 (8) · 3103
DOI: 10.3390/jcm15083103 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Clinical Medicine, online erschienen am 18.04.2026. Verfasst von Tai Metzger und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Foundational Medical Studies, Oakland University William Beaumont School of Medicine, Rochester, MI 48309, USA. Die Arbeit nennt 42 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Background/Objectives: As use of large language models (LLMs) in clinical practice, in medical education, and by patients increases, it is essential to ensure that information provided is accurate and safe. Our objective was to compare stage two hypertension treatment plans generated by popular LLMs.
Methods
ChatGPT (GPT-4o), Claude (Claude 4 Sonnet), ClinicalKey AI, Microsoft Copilot (Wave 2), DeepSeek-V3-0324, Dyna AI, Google Gemini (2.5 Flash), Grok (version 3), Meta AI assistant (Llama 4 Maverick), OpenEvidence (version 2.0), Perplexity (Sonar backend model), and Pi (Inflection-2.5) were prompted to generate a treatment plan for stage two hypertension. Six blinded reviewers scored each response in three domains: adherence to clinical guidelines, detail/clarity, and reliability/safety.
Results
Perplexity received the highest composite score (8.17 out of 9), followed by OpenEvidence (7.92 out of 9). Dyna AI had the lowest overall score (3.75 out of 9). Perplexity (3.00 out of 3), Grok (2.83 out of 3), and OpenEvidence (2.75 out of 3) had the highest scores for detail/clarity, while Dyna AI had the lowest for both detail/clarity (1.00 out of 3) and reliability/safety (1.00 out of 3). ChatGPT had the highest score for adherence to guidelines (2.75 out of 3) while Pi had the lowest (1.58 out of 3). Kruskal–Wallis test showed p < 0.05 across sub-score domains and composite scores.
Conclusions
LLMs tended to adhere to clinical guidelines and provide detailed responses but often did not provide sources or instruct users to see a healthcare professional. There was notable variability in quality, and medicine-specific LLMs were not superior to popular LLMs.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Foundational Medical Studies, Oakland University William Beaumont School of Medicine, Rochester, MI 48309, USA.
- Department of Cardiovascular Medicine, Corewell Health William Beaumont University Hospital, Royal Oak, MI 48073, USA.
ORCID-Profile: Tai Metzger, Zaheen Hossain, Kody Park, Tracey A H Taylor
Zitieren
APA
Metzger, T., Hossain, Z., Park, K., Vu, S., Dixon, S., & Taylor, T. A. H. (2026). Assessment of Stage Two Hypertension Treatment Plans Written by Generative AI. Journal of Clinical Medicine, 15(8), 3103. https://doi.org/10.3390/jcm15083103
Vancouver
Metzger T, Hossain Z, Park K, Vu S, Dixon S, Taylor TAH. Assessment of Stage Two Hypertension Treatment Plans Written by Generative AI. Journal of Clinical Medicine. 2026;15(8):3103. doi:10.3390/jcm15083103
BibTeX
@article{Metzger2026,
author = {Metzger, Tai and Hossain, Zaheen and Park, Kody and Vu, Stephen and Dixon, Simon and Taylor, Tracey A H},
title = {Assessment of Stage Two Hypertension Treatment Plans Written by Generative AI},
journal = {Journal of Clinical Medicine},
year = {2026},
volume = {15},
number = {8},
pages = {3103},
doi = {10.3390/jcm15083103}
}
EUVIMED