EUVIMEDEUVIMED entdecken
ÜbersichtsarbeitLeitlinieOpen Access

The TRIPOD-LLM reporting guideline for studies using large language models

Jack Gallifant iD, Majid Afshar, Saleem Ameen iD, Yindalon Aphinyanaphongs iD, Shan Chen iD, Giovanni Cacciamani iD, Dina Demner-Fushman, Dmitriy Dligach, Roxana Daneshjou iD, Chrystinne Fernandes, Lasse Hyldig Hansen iD, Adam Landman und 13 weitere

Nature Medicine · 2025-01 · 31 (1) · 60-69

DOI: 10.1038/s41591-024-03425-5 ↗

Kurz gefasst

Übersichtsarbeit in der Zeitschrift Nature Medicine, online erschienen am 08.01.2025. Verfasst von Jack Gallifant und 24 weiteren Autor:innen. Beteiligte Einrichtung: Laboratory for Computational Physiology, Massachusetts Institute of Technology, Cambridge, MA, USA. Hauptthemen laut MEDLINE: Guidelines as Topic. Die Arbeit wurde bisher 725-mal zitiert (Crossref) und nennt 64 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: NCI NIH HHS, NLM NIH HHS, National Science Foundation (NSF).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Large language models (LLMs) are rapidly being adopted in healthcare, necessitating standardized reporting guidelines. We present transparent reporting of a multivariable model for individual prognosis or diagnosis (TRIPOD)-LLM, an extension of the TRIPOD + artificial intelligence statement, addressing the unique challenges of LLMs in biomedical applications. TRIPOD-LLM provides a comprehensive checklist of 19 main items and 50 subitems, covering key aspects from title to discussion. The guidelines introduce a modular format accommodating various LLM research designs and tasks, with 14 main items and 32 subitems applicable across all categories. Developed through an expedited Delphi process and expert consensus, TRIPOD-LLM emphasizes transparency, human oversight and task-specific performance reporting. We also introduce an interactive website ( https://tripod-llm.vercel.app/ ) facilitating easy guideline completion and PDF generation for submission. As a living document, TRIPOD-LLM will evolve with the field, aiming to enhance the quality, reproducibility and clinical applicability of LLM research in healthcare through comprehensive reporting.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Guidelines as TopicHumansArtificial IntelligenceResearch DesignPrognosisDelphi TechniqueLarge Language Models

Autor:innen und Institutionen

  • Laboratory for Computational Physiology, Massachusetts Institute of Technology, Cambridge, MA, USA.
  • Department of Critical Care, Guy's and St Thomas' NHS Foundation Trust, London, UK.
  • Artificial Intelligence in Medicine (AIM) Program, Mass General Brigham, Harvard Medical School, Boston, MA, USA.
  • Department of Medicine, University of Wisconsin-Madison, Madison, WI, USA.
  • Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA.
  • Tasmanian School of Medicine, College of Health and Medicine, University of Tasmania, Hobart, Tasmania, Australia.

ORCID-Profile: Jack Gallifant, Saleem Ameen, Yindalon Aphinyanaphongs, Shan Chen, Giovanni Cacciamani, Roxana Daneshjou, Lasse Hyldig Hansen, Timothy Miller, David Restrepo, Renato Umeton, Judy Wawira Gichoya, Gary S Collins, Leo A Celi

Förderung

  • NCI NIH HHS
  • NLM NIH HHS
  • National Science Foundation (NSF)

Zitieren

APA

Gallifant, J., Afshar, M., Ameen, S., Aphinyanaphongs, Y., Chen, S., Cacciamani, G., Demner-Fushman, D., Dligach, D., Daneshjou, R., Fernandes, C., Hansen, L. H., Landman, A., Lehmann, L., McCoy, L. G., Miller, T., Moreno, A., Munch, N., Restrepo, D., Savova, G., …, & Bitterman, D. S. (2025). The TRIPOD-LLM reporting guideline for studies using large language models. Nature Medicine, 31(1), 60-69. https://doi.org/10.1038/s41591-024-03425-5

Vancouver

Gallifant J, Afshar M, Ameen S, Aphinyanaphongs Y, Chen S, Cacciamani G, et al. The TRIPOD-LLM reporting guideline for studies using large language models. Nature Medicine. 2025;31(1):60-69. doi:10.1038/s41591-024-03425-5

BibTeX
@article{Gallifant2025,
  author = {Gallifant, Jack and Afshar, Majid and Ameen, Saleem and Aphinyanaphongs, Yindalon and Chen, Shan and Cacciamani, Giovanni and Demner-Fushman, Dina and Dligach, Dmitriy and Daneshjou, Roxana and Fernandes, Chrystinne and Hansen, Lasse Hyldig and Landman, Adam and Lehmann, Lisa and McCoy, Liam G and Miller, Timothy and Moreno, Amy and Munch, Nikolaj and Restrepo, David and Savova, Guergana and Umeton, Renato and Gichoya, Judy Wawira and Collins, Gary S and Moons, Karel G M and Celi, Leo A and Bitterman, Danielle S},
  title = {The TRIPOD-LLM reporting guideline for studies using large language models},
  journal = {Nature Medicine},
  year = {2025},
  volume = {31},
  number = {1},
  pages = {60--69},
  doi = {10.1038/s41591-024-03425-5}
}
Kostenlos starten →