EUVIMEDEUVIMED entdecken
Leitlinie

Reporting Guideline for Chatbot Health Advice Studies

CHART Collaborative, Bright Huo, Gary S Collins, David Chartash, Arun J Thirunavukarasu, Annette Flanagin, Alfonso Iorio, Giovanni Cacciamani, Xi Chen, Nan Liu, Piyush Mathur, An-Wen Chan und 35 weitere

JAMA Network Open · 01.08.2025 · 8 (8) · e2530220

DOI: 10.1001/jamanetworkopen.2025.30220 ↗

Kurz gefasst

Leitlinie in der Zeitschrift JAMA Network Open, online erschienen am 01.08.2025. Verfasst von CHART Collaborative und 46 weiteren Autor:innen. Beteiligte Einrichtung: Division of General Surgery, Department of Surgery, McMaster University, Hamilton, Ontario, Canada. Hauptthemen laut MEDLINE: Artificial Intelligence, Research Design, Guidelines as Topic, Research Report. Die Arbeit wurde bisher 64-mal zitiert (Crossref) und nennt 34 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Importance The rise in chatbot health advice (CHA) studies is accompanied by heterogeneity in reporting standards, impacting their interpretability.

Objective

To provide reporting recommendations for studies evaluating the performance of generative artificial intelligence (AI)–driven chatbots when summarizing clinical evidence and providing health advice. Design, Setting, and Participants CHART was developed in several phases after performing a comprehensive systematic review to identify variation in the conduct, reporting, and methodology in CHA studies. Findings from the review were used to develop a draft checklist that was revised through an international, multidisciplinary modified asynchronous Delphi consensus process of 531 stakeholders, 3 synchronous panel consensus meetings of 48 stakeholders, and subsequent pilot testing of the checklist.

Results

CHART includes 12 items and 39 subitems to promote transparent and comprehensive reporting of CHA studies. These include title (subitem 1a), abstract or summary (subitem 1b), background (subitems 2ab), model identifiers (subitem 3ab), model details (subitems 4abc), prompt engineering (subitems 5ab), query strategy (subitems 6abcd), performance evaluation (subitems 7ab), sample size (subitem 8), data analysis (subitem 9a), results (subitems 10abc), discussion (subitems 11abc), disclosures (subitem 12a), funding (subitem 12b), ethics (subitem 12c), protocol (subitem 12d), and data availability (subitem 12e). Conclusions and Relevance The CHART checklist and corresponding methodological diagram were designed to support key stakeholders including clinicians, researchers, editors, peer reviewers, and readers in reporting, understanding, and interpreting the findings of CHA studies.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Artificial IntelligenceResearch DesignGuidelines as TopicResearch ReportHumansChecklistDelphi TechniqueGenerative Artificial Intelligence

Autor:innen und Institutionen

  • Division of General Surgery, Department of Surgery, McMaster University, Hamilton, Ontario, Canada.
  • UK EQUATOR Centre, University of Oxford, Oxford, United Kingdom.
  • Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, Botnar Research Centre, University of Oxford, Oxford, United Kingdom.
  • Department of Biomedical Informatics and Data Science, Yale University School of Medicine, New Haven, Connecticut.
  • Nuffield Department of Clinical Neurosciences, Medical Sciences Division, University of Oxford, Oxford, United Kingdom.
  • JAMA and JAMA Network, American Medical Association, Chicago, Illinois.

Zitieren

APA

CHART Collaborative, Huo, B., Collins, G. S., Chartash, D., Thirunavukarasu, A. J., Flanagin, A., Iorio, A., Cacciamani, G., Chen, X., Liu, N., Mathur, P., Chan, A. W., Laine, C., Pacella, D., Berkwits, M., Antoniou, S. A., Camaradou, J. C., Canfield, C., Mittelman, M., …, & Guyatt, G. H. (2025). Reporting Guideline for Chatbot Health Advice Studies. JAMA Network Open, 8(8), e2530220. https://doi.org/10.1001/jamanetworkopen.2025.30220

Vancouver

CHART Collaborative, Huo B, Collins GS, Chartash D, Thirunavukarasu AJ, Flanagin A, et al. Reporting Guideline for Chatbot Health Advice Studies. JAMA Network Open. 2025;8(8):e2530220. doi:10.1001/jamanetworkopen.2025.30220

BibTeX
@article{CHARTCollaborative2025,
  author = {CHART Collaborative, CHART Collaborative and Huo, Bright and Collins, Gary S and Chartash, David and Thirunavukarasu, Arun J and Flanagin, Annette and Iorio, Alfonso and Cacciamani, Giovanni and Chen, Xi and Liu, Nan and Mathur, Piyush and Chan, An-Wen and Laine, Christine and Pacella, Daniela and Berkwits, Michael and Antoniou, Stavros A and Camaradou, Jennifer C and Canfield, Carolyn and Mittelman, Michael and Feeney, Timothy and Loder, Elizabeth W and Agha, Riaz and Saha, Ashirbani and Mayol, Julio and Sunjaya, Anthony and Harvey, Hugh and Ng, Jeremy Y and McKechnie, Tyler and Lee, Yung and Verma, Nipun and Stiglic, Gregor and McCradden, Melissa and Ramji, Karim and Boudreau, Vanessa and Ortenzi, Monica and Meerpohl, Joerg J and Vandvik, Per Olav and Agoritsas, Thomas and Samuel, Diana and Frankish, Helen and Anderson, Michael and Yao, Xiaomei and Loeb, Stacy and Lokker, Cynthia and Liu, Xiaoxuan and Guallar, Eliseo and Guyatt, Gordon H},
  title = {Reporting Guideline for Chatbot Health Advice Studies},
  journal = {JAMA Network Open},
  year = {2025},
  volume = {8},
  number = {8},
  pages = {e2530220},
  doi = {10.1001/jamanetworkopen.2025.30220}
}
Kostenlos starten →