The TRIPOD-LLM reporting guideline for studies using large language models
Nature Medicine · 2025-01 · 31 (1) · 60-69
DOI: 10.1038/s41591-024-03425-5 ↗Kurz gefasst
Übersichtsarbeit in der Zeitschrift Nature Medicine, online erschienen am 08.01.2025. Verfasst von Jack Gallifant und 24 weiteren Autor:innen. Beteiligte Einrichtung: Laboratory for Computational Physiology, Massachusetts Institute of Technology, Cambridge, MA, USA. Hauptthemen laut MEDLINE: Guidelines as Topic. Die Arbeit wurde bisher 725-mal zitiert (Crossref) und nennt 64 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: NCI NIH HHS, NLM NIH HHS, National Science Foundation (NSF).
Abstract (Originalsprache)
Large language models (LLMs) are rapidly being adopted in healthcare, necessitating standardized reporting guidelines. We present transparent reporting of a multivariable model for individual prognosis or diagnosis (TRIPOD)-LLM, an extension of the TRIPOD + artificial intelligence statement, addressing the unique challenges of LLMs in biomedical applications. TRIPOD-LLM provides a comprehensive checklist of 19 main items and 50 subitems, covering key aspects from title to discussion. The guidelines introduce a modular format accommodating various LLM research designs and tasks, with 14 main items and 32 subitems applicable across all categories. Developed through an expedited Delphi process and expert consensus, TRIPOD-LLM emphasizes transparency, human oversight and task-specific performance reporting. We also introduce an interactive website ( https://tripod-llm.vercel.app/ ) facilitating easy guideline completion and PDF generation for submission. As a living document, TRIPOD-LLM will evolve with the field, aiming to enhance the quality, reproducibility and clinical applicability of LLM research in healthcare through comprehensive reporting.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Laboratory for Computational Physiology, Massachusetts Institute of Technology, Cambridge, MA, USA.
- Department of Critical Care, Guy's and St Thomas' NHS Foundation Trust, London, UK.
- Artificial Intelligence in Medicine (AIM) Program, Mass General Brigham, Harvard Medical School, Boston, MA, USA.
- Department of Medicine, University of Wisconsin-Madison, Madison, WI, USA.
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA.
- Tasmanian School of Medicine, College of Health and Medicine, University of Tasmania, Hobart, Tasmania, Australia.
ORCID-Profile: Jack Gallifant, Saleem Ameen, Yindalon Aphinyanaphongs, Shan Chen, Giovanni Cacciamani, Roxana Daneshjou, Lasse Hyldig Hansen, Timothy Miller, David Restrepo, Renato Umeton, Judy Wawira Gichoya, Gary S Collins, Leo A Celi
Förderung
- NCI NIH HHS
- NLM NIH HHS
- National Science Foundation (NSF)
Zitieren
APA
Gallifant, J., Afshar, M., Ameen, S., Aphinyanaphongs, Y., Chen, S., Cacciamani, G., Demner-Fushman, D., Dligach, D., Daneshjou, R., Fernandes, C., Hansen, L. H., Landman, A., Lehmann, L., McCoy, L. G., Miller, T., Moreno, A., Munch, N., Restrepo, D., Savova, G., …, & Bitterman, D. S. (2025). The TRIPOD-LLM reporting guideline for studies using large language models. Nature Medicine, 31(1), 60-69. https://doi.org/10.1038/s41591-024-03425-5
Vancouver
Gallifant J, Afshar M, Ameen S, Aphinyanaphongs Y, Chen S, Cacciamani G, et al. The TRIPOD-LLM reporting guideline for studies using large language models. Nature Medicine. 2025;31(1):60-69. doi:10.1038/s41591-024-03425-5
BibTeX
@article{Gallifant2025,
author = {Gallifant, Jack and Afshar, Majid and Ameen, Saleem and Aphinyanaphongs, Yindalon and Chen, Shan and Cacciamani, Giovanni and Demner-Fushman, Dina and Dligach, Dmitriy and Daneshjou, Roxana and Fernandes, Chrystinne and Hansen, Lasse Hyldig and Landman, Adam and Lehmann, Lisa and McCoy, Liam G and Miller, Timothy and Moreno, Amy and Munch, Nikolaj and Restrepo, David and Savova, Guergana and Umeton, Renato and Gichoya, Judy Wawira and Collins, Gary S and Moons, Karel G M and Celi, Leo A and Bitterman, Danielle S},
title = {The TRIPOD-LLM reporting guideline for studies using large language models},
journal = {Nature Medicine},
year = {2025},
volume = {31},
number = {1},
pages = {60--69},
doi = {10.1038/s41591-024-03425-5}
}
EUVIMED