Reporting Guideline for Chatbot Health Advice Studies
JAMA Network Open · 01.08.2025 · 8 (8) · e2530220
DOI: 10.1001/jamanetworkopen.2025.30220 ↗Kurz gefasst
Leitlinie in der Zeitschrift JAMA Network Open, online erschienen am 01.08.2025. Verfasst von CHART Collaborative und 46 weiteren Autor:innen. Beteiligte Einrichtung: Division of General Surgery, Department of Surgery, McMaster University, Hamilton, Ontario, Canada. Hauptthemen laut MEDLINE: Artificial Intelligence, Research Design, Guidelines as Topic, Research Report. Die Arbeit wurde bisher 64-mal zitiert (Crossref) und nennt 34 Literaturangaben.
Abstract (Originalsprache)
Importance The rise in chatbot health advice (CHA) studies is accompanied by heterogeneity in reporting standards, impacting their interpretability.
Objective
To provide reporting recommendations for studies evaluating the performance of generative artificial intelligence (AI)–driven chatbots when summarizing clinical evidence and providing health advice. Design, Setting, and Participants CHART was developed in several phases after performing a comprehensive systematic review to identify variation in the conduct, reporting, and methodology in CHA studies. Findings from the review were used to develop a draft checklist that was revised through an international, multidisciplinary modified asynchronous Delphi consensus process of 531 stakeholders, 3 synchronous panel consensus meetings of 48 stakeholders, and subsequent pilot testing of the checklist.
Results
CHART includes 12 items and 39 subitems to promote transparent and comprehensive reporting of CHA studies. These include title (subitem 1a), abstract or summary (subitem 1b), background (subitems 2ab), model identifiers (subitem 3ab), model details (subitems 4abc), prompt engineering (subitems 5ab), query strategy (subitems 6abcd), performance evaluation (subitems 7ab), sample size (subitem 8), data analysis (subitem 9a), results (subitems 10abc), discussion (subitems 11abc), disclosures (subitem 12a), funding (subitem 12b), ethics (subitem 12c), protocol (subitem 12d), and data availability (subitem 12e). Conclusions and Relevance The CHART checklist and corresponding methodological diagram were designed to support key stakeholders including clinicians, researchers, editors, peer reviewers, and readers in reporting, understanding, and interpreting the findings of CHA studies.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Division of General Surgery, Department of Surgery, McMaster University, Hamilton, Ontario, Canada.
- UK EQUATOR Centre, University of Oxford, Oxford, United Kingdom.
- Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, Botnar Research Centre, University of Oxford, Oxford, United Kingdom.
- Department of Biomedical Informatics and Data Science, Yale University School of Medicine, New Haven, Connecticut.
- Nuffield Department of Clinical Neurosciences, Medical Sciences Division, University of Oxford, Oxford, United Kingdom.
- JAMA and JAMA Network, American Medical Association, Chicago, Illinois.
Zitieren
APA
CHART Collaborative, Huo, B., Collins, G. S., Chartash, D., Thirunavukarasu, A. J., Flanagin, A., Iorio, A., Cacciamani, G., Chen, X., Liu, N., Mathur, P., Chan, A. W., Laine, C., Pacella, D., Berkwits, M., Antoniou, S. A., Camaradou, J. C., Canfield, C., Mittelman, M., …, & Guyatt, G. H. (2025). Reporting Guideline for Chatbot Health Advice Studies. JAMA Network Open, 8(8), e2530220. https://doi.org/10.1001/jamanetworkopen.2025.30220
Vancouver
CHART Collaborative, Huo B, Collins GS, Chartash D, Thirunavukarasu AJ, Flanagin A, et al. Reporting Guideline for Chatbot Health Advice Studies. JAMA Network Open. 2025;8(8):e2530220. doi:10.1001/jamanetworkopen.2025.30220
BibTeX
@article{CHARTCollaborative2025,
author = {CHART Collaborative, CHART Collaborative and Huo, Bright and Collins, Gary S and Chartash, David and Thirunavukarasu, Arun J and Flanagin, Annette and Iorio, Alfonso and Cacciamani, Giovanni and Chen, Xi and Liu, Nan and Mathur, Piyush and Chan, An-Wen and Laine, Christine and Pacella, Daniela and Berkwits, Michael and Antoniou, Stavros A and Camaradou, Jennifer C and Canfield, Carolyn and Mittelman, Michael and Feeney, Timothy and Loder, Elizabeth W and Agha, Riaz and Saha, Ashirbani and Mayol, Julio and Sunjaya, Anthony and Harvey, Hugh and Ng, Jeremy Y and McKechnie, Tyler and Lee, Yung and Verma, Nipun and Stiglic, Gregor and McCradden, Melissa and Ramji, Karim and Boudreau, Vanessa and Ortenzi, Monica and Meerpohl, Joerg J and Vandvik, Per Olav and Agoritsas, Thomas and Samuel, Diana and Frankish, Helen and Anderson, Michael and Yao, Xiaomei and Loeb, Stacy and Lokker, Cynthia and Liu, Xiaoxuan and Guallar, Eliseo and Guyatt, Gordon H},
title = {Reporting Guideline for Chatbot Health Advice Studies},
journal = {JAMA Network Open},
year = {2025},
volume = {8},
number = {8},
pages = {e2530220},
doi = {10.1001/jamanetworkopen.2025.30220}
}
EUVIMED