Optimizing large language models in digestive disease: strategies and challenges to improve clinical outcomes
Liver International · 2024-09 · 44 (9) · 2114-2124
DOI: 10.1111/liv.15974 ↗Kurz gefasst
Übersichtsarbeit in der Zeitschrift Liver International, online erschienen am 31.05.2024. Verfasst von Mauro Giuffrè und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Internal Medicine (Digestive Diseases), Yale School of Medicine, New Haven, Connecticut, USA. Hauptthemen laut MEDLINE: Digestive System Diseases, Neural Networks, Computer. Die Arbeit wurde bisher 58-mal zitiert (Crossref) und nennt 50 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NIDDK NIH HHS.
Abstract (Originalsprache)
Large Language Models (LLMs) are transformer‐based neural networks with billions of parameters trained on very large text corpora from diverse sources. LLMs have the potential to improve healthcare due to their capability to parse complex concepts and generate context‐based responses. The interest in LLMs has not spared digestive disease academics, who have mainly investigated foundational LLM accuracy, which ranges from 25% to 90% and is influenced by the lack of standardized rules to report methodologies and results for LLM‐oriented research. In addition, a critical issue is the absence of a universally accepted definition of accuracy, varying from binary to scalar interpretations, often tied to grader expertise without reference to clinical guidelines. We address strategies and challenges to increase accuracy. In particular, LLMs can be infused with domain knowledge using Retrieval Augmented Generation (RAG) or Supervised Fine‐Tuning (SFT) with reinforcement learning from human feedback (RLHF). RAG faces challenges with in‐context window limits and accurate information retrieval from the provided context. SFT, a deeper adaptation method, is computationally demanding and requires specialized knowledge. LLMs may increase patient quality of care across the field of digestive diseases, where physicians are often engaged in screening, treatment and surveillance for a broad range of pathologies for which in‐context learning or SFT with RLHF could improve clinical decision‐making and patient outcomes. However, despite their potential, the safe deployment of LLMs in healthcare still needs to overcome hurdles in accuracy, suggesting a need for strategies that integrate human feedback with advanced model training.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Internal Medicine (Digestive Diseases), Yale School of Medicine, New Haven, Connecticut, USA.
- Department of Medical, Surgical, and Health Sciences, University of Trieste, Trieste, Italy.
- Department of Engineering and Architecture, University of Trieste, Trieste, Italy.
- Division of Internal Medicine and Hepatology, Department of Gastroenterology, IRCCS Humanitas Research Hospital, Rozzano, Italy.
- Department of Biomedical Sciences, Humanitas University, Pieve Emanuele, Italy.
- Department of Mathematics, Baruch College, City University of New York, New York, New York, USA.
ORCID-Profile: Nicola Pugliese
Förderung
- NIDDK NIH HHS
Zitieren
APA
Giuffrè, M., Kresevic, S., Pugliese, N., You, K., & Shung, D. L. (2024). Optimizing large language models in digestive disease: strategies and challenges to improve clinical outcomes. Liver International, 44(9), 2114-2124. https://doi.org/10.1111/liv.15974
Vancouver
Giuffrè M, Kresevic S, Pugliese N, You K, Shung DL. Optimizing large language models in digestive disease: strategies and challenges to improve clinical outcomes. Liver International. 2024;44(9):2114-2124. doi:10.1111/liv.15974
BibTeX
@article{Giuffr2024,
author = {Giuffrè, Mauro and Kresevic, Simone and Pugliese, Nicola and You, Kisung and Shung, Dennis L},
title = {Optimizing large language models in digestive disease: strategies and challenges to improve clinical outcomes},
journal = {Liver International},
year = {2024},
volume = {44},
number = {9},
pages = {2114--2124},
doi = {10.1111/liv.15974}
}
EUVIMED