EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Assessment of Stage Two Hypertension Treatment Plans Written by Generative AI

Tai Metzger iD, Zaheen Hossain iD, Kody Park iD, Stephen Vu, Simon Dixon, Tracey A H Taylor iD

Journal of Clinical Medicine · 18.04.2026 · 15 (8) · 3103

DOI: 10.3390/jcm15083103 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Clinical Medicine, online erschienen am 18.04.2026. Verfasst von Tai Metzger und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Foundational Medical Studies, Oakland University William Beaumont School of Medicine, Rochester, MI 48309, USA. Die Arbeit nennt 42 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background/Objectives: As use of large language models (LLMs) in clinical practice, in medical education, and by patients increases, it is essential to ensure that information provided is accurate and safe. Our objective was to compare stage two hypertension treatment plans generated by popular LLMs.

Methods

ChatGPT (GPT-4o), Claude (Claude 4 Sonnet), ClinicalKey AI, Microsoft Copilot (Wave 2), DeepSeek-V3-0324, Dyna AI, Google Gemini (2.5 Flash), Grok (version 3), Meta AI assistant (Llama 4 Maverick), OpenEvidence (version 2.0), Perplexity (Sonar backend model), and Pi (Inflection-2.5) were prompted to generate a treatment plan for stage two hypertension. Six blinded reviewers scored each response in three domains: adherence to clinical guidelines, detail/clarity, and reliability/safety.

Results

Perplexity received the highest composite score (8.17 out of 9), followed by OpenEvidence (7.92 out of 9). Dyna AI had the lowest overall score (3.75 out of 9). Perplexity (3.00 out of 3), Grok (2.83 out of 3), and OpenEvidence (2.75 out of 3) had the highest scores for detail/clarity, while Dyna AI had the lowest for both detail/clarity (1.00 out of 3) and reliability/safety (1.00 out of 3). ChatGPT had the highest score for adherence to guidelines (2.75 out of 3) while Pi had the lowest (1.58 out of 3). Kruskal–Wallis test showed p < 0.05 across sub-score domains and composite scores.

Conclusions

LLMs tended to adhere to clinical guidelines and provide detailed responses but often did not provide sources or instruct users to see a healthcare professional. There was notable variability in quality, and medicine-specific LLMs were not superior to popular LLMs.

Schlagwörter

Stichwörter der Autor:innen

artificial intelligencecardiovascular diseasehypertensionlarge language models

Autor:innen und Institutionen

  • Department of Foundational Medical Studies, Oakland University William Beaumont School of Medicine, Rochester, MI 48309, USA.
  • Department of Cardiovascular Medicine, Corewell Health William Beaumont University Hospital, Royal Oak, MI 48073, USA.

ORCID-Profile: Tai Metzger, Zaheen Hossain, Kody Park, Tracey A H Taylor

Zitieren

APA

Metzger, T., Hossain, Z., Park, K., Vu, S., Dixon, S., & Taylor, T. A. H. (2026). Assessment of Stage Two Hypertension Treatment Plans Written by Generative AI. Journal of Clinical Medicine, 15(8), 3103. https://doi.org/10.3390/jcm15083103

Vancouver

Metzger T, Hossain Z, Park K, Vu S, Dixon S, Taylor TAH. Assessment of Stage Two Hypertension Treatment Plans Written by Generative AI. Journal of Clinical Medicine. 2026;15(8):3103. doi:10.3390/jcm15083103

BibTeX
@article{Metzger2026,
  author = {Metzger, Tai and Hossain, Zaheen and Park, Kody and Vu, Stephen and Dixon, Simon and Taylor, Tracey A H},
  title = {Assessment of Stage Two Hypertension Treatment Plans Written by Generative AI},
  journal = {Journal of Clinical Medicine},
  year = {2026},
  volume = {15},
  number = {8},
  pages = {3103},
  doi = {10.3390/jcm15083103}
}
Kostenlos starten →