Building safer artificial intelligence mental health chatbots: a framework for transparency, evaluation, and shared accountability
Journal of the American Medical Informatics Association · 01.08.2026 · 33 (8) · 1538-1553
DOI: 10.1093/jamia/ocag078 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of the American Medical Informatics Association, online erschienen am 20.05.2026. Verfasst von Hannah Lee und 3 weiteren Autor:innen. Beteiligte Einrichtung: School of Medicine, Stanford University, Stanford, CA 94305, United States. Hauptthemen laut MEDLINE: Artificial Intelligence, Patient Safety. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 62 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Background
Generative artificial intelligence (AI) chatbots built on large language models are rapidly entering mental-health care, offering human-like support without meeting evidentiary standards for safety or effectiveness.
Objective
To examine the risks, and outline a governance framework capable of supporting safe, accountable, and equitable deployment of AI mental-health chatbots.
Methods
We synthesized recent clinical, regulatory, and behavioral health literature on AI mental health chatbots, including reported harms and system failure modes, to identify governance gaps and develop a 3-stage safety framework.
Conclusions
Embedding transparency, standardized evaluation, and ongoing oversight across the chatbot lifecycle, with clear responsibilities shared among developers, regulators, clinicians, researchers, and professional societies, is essential to ensure that AI systems intended to support mental health do not inadvertently cause harm.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Medicine, Stanford University, Stanford, CA 94305, United States.
- Department of Medicine, Biomedical Informatics, Stanford University, Stanford, CA 94305, United States.
- Department of Biomedical Data Science, Stanford University, Stanford, CA 94305, United States.
- Department of Surgery, Stanford University, Stanford, CA 94305, United States.
ORCID-Profile: Tina Hernandez-Boussard
Zitieren
APA
Lee, H., Handler, R., Mungle, T., & Hernandez-Boussard, T. (2026). Building safer artificial intelligence mental health chatbots: a framework for transparency, evaluation, and shared accountability. Journal of the American Medical Informatics Association, 33(8), 1538-1553. https://doi.org/10.1093/jamia/ocag078
Vancouver
Lee H, Handler R, Mungle T, Hernandez-Boussard T. Building safer artificial intelligence mental health chatbots: a framework for transparency, evaluation, and shared accountability. Journal of the American Medical Informatics Association. 2026;33(8):1538-1553. doi:10.1093/jamia/ocag078
BibTeX
@article{Lee2026,
author = {Lee, Hannah and Handler, Rebecca and Mungle, Tushar and Hernandez-Boussard, Tina},
title = {Building safer artificial intelligence mental health chatbots: a framework for transparency, evaluation, and shared accountability},
journal = {Journal of the American Medical Informatics Association},
year = {2026},
volume = {33},
number = {8},
pages = {1538--1553},
doi = {10.1093/jamia/ocag078}
}
EUVIMED