EUVIMEDEUVIMED entdecken
ÜbersichtsarbeitSystematische ÜbersichtLeitlinieOpen Access

Safety-Oriented Evaluation of Large Language Models in Health Care: Guideline-Informed Systematic Review

Hikaru Matsuoka, Takayuki Takahashi, Takayuki Semitsu, Keiko Matsuoka, Ryoma Hayashi

Online Journal of Public Health Informatics · 20.08.2026 · 18 · e97240-e97240

DOI: 10.2196/97240 ↗

Kurz gefasst

Übersichtsarbeit in der Zeitschrift Online Journal of Public Health Informatics, online erschienen am 20.08.2026. Verfasst von Hikaru Matsuoka und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Information Security, Faculty of Information Systems, University of Nagasaki, Nagasaki, Nagasaki, Japan. Die Arbeit nennt 29 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Large language models (LLMs) are rapidly emerging in health care, offering opportunities in decision support, education, and research, but raising critical concerns about safety, reliability, and ethics. Although several guidelines for trustworthy AI exist in business and technology, few systematic reviews have applied them to medical contexts.

Objective

This study aimed to conduct a systematic review of LLM research in health care, applying the AI Guidelines for Business as a framework across 11 domains, including safety, reliability, ethics, transparency, fairness, inclusiveness, privacy, security, robustness, data quality, and verifiability.

Methods

Following PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) 2020 guidelines (retrospectively registered on the Open Science Framework; DOI 10.17605/OSF.IO/P4KSB), the PubMed, Scopus, Web of Science, arXiv, and IEEE Xplore databases were searched on January 15, 2025. Records were screened in 2 stages by 3 reviewers (with records retained only upon unanimous agreement). A total of 247 studies were included, of which 211 (85.4%) contributed quantitative values. Eligible studies were classified across 11 trustworthy AI domains. Heterogeneous metrics were summarized within metric families; when multiple models were evaluated, the mean across models was used as the primary estimate, with best, median, and primary-model sensitivity analyses. The LLM-assisted categorization (GPT-5 mini) was validated by using an automated internal consistency check, and 95% CIs were estimated by using cluster bootstrap on study-level values.

Results

Of the 25,156 records, 247 (1.0%) studies were included, and of these, 211 (85.4%) contributed quantitative values. Evaluation concentrated on accuracy (143/247, 57.9%) and fairness and inclusiveness (93/247, 37.7%), followed by data quality (47/247, 19.0%) and prevention of misinformation (44/247, 17.8%). Normalized performance was moderate to high (accuracy mean 0.73, 95% CI 0.7-0.76; data quality: 0.64; prevention of misinformation: 0.82). Selecting the best-performing model inflated domain means by up to 0.05. Privacy protection (2/247, 0.8%) and security assurance (0/247, 0.0%) were almost entirely absent. Domain assignments were recoverable from objective metric types in 98.9% of values (Cohen κ=0.985).

Conclusions

Current evaluations emphasize accuracy while underreporting privacy, security, robustness, explainability, and verifiability. This finding reflects gaps in reporting rather than demonstrated poor performance, underscoring the need for comprehensive, guideline-based, multidomain evaluation before deployment in high-stakes clinical settings.

Schlagwörter

Stichwörter der Autor:innen

AIartificial intelligenceclinical decision supportevaluation frameworkguidelinehealth care informaticslarge language modelpatient safetypublic health informaticssystematic reviewtrustworthy AItrustworthy artificial intelligence

Autor:innen und Institutionen

  • Department of Information Security, Faculty of Information Systems, University of Nagasaki, Nagasaki, Nagasaki, Japan.
  • Information-Technology Promotion Agency, Minato, Tokyo, Japan.
  • Statistical Genetics Team, RIKEN Center for Advanced Intelligence Project, Nihonbashi 1-chome Mitsui Building 15F, 1-4-1 Nihonbashi, Chuo-ku, Tokyo, 103-0027, Japan, 81 3-6225-2482.
  • Department of Obstetrics and Gynecology, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-ku, Tokyo, Japan.
  • Department of Obstetrics and Gynecology, Shonan Atsugi Hospital, Atsugi, Kanagawa, Japan.

Zitieren

APA

Matsuoka, H., Takahashi, T., Semitsu, T., Matsuoka, K., & Hayashi, R. (2026). Safety-Oriented Evaluation of Large Language Models in Health Care: Guideline-Informed Systematic Review. Online Journal of Public Health Informatics, 18, e97240-e97240. https://doi.org/10.2196/97240

Vancouver

Matsuoka H, Takahashi T, Semitsu T, Matsuoka K, Hayashi R. Safety-Oriented Evaluation of Large Language Models in Health Care: Guideline-Informed Systematic Review. Online Journal of Public Health Informatics. 2026;18:e97240-e97240. doi:10.2196/97240

BibTeX
@article{Matsuoka2026,
  author = {Matsuoka, Hikaru and Takahashi, Takayuki and Semitsu, Takayuki and Matsuoka, Keiko and Hayashi, Ryoma},
  title = {Safety-Oriented Evaluation of Large Language Models in Health Care: Guideline-Informed Systematic Review},
  journal = {Online Journal of Public Health Informatics},
  year = {2026},
  volume = {18},
  pages = {e97240--e97240},
  doi = {10.2196/97240}
}
Kostenlos starten →