EUVIMEDEUVIMED entdecken
ÜbersichtsarbeitOpen Access · CC BY 4.0

Optimizing large language models in digestive disease: strategies and challenges to improve clinical outcomes

Mauro Giuffrè, Simone Kresevic, Nicola Pugliese iD, Kisung You, Dennis L Shung

Liver International · 2024-09 · 44 (9) · 2114-2124

DOI: 10.1111/liv.15974 ↗

Kurz gefasst

Übersichtsarbeit in der Zeitschrift Liver International, online erschienen am 31.05.2024. Verfasst von Mauro Giuffrè und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Internal Medicine (Digestive Diseases), Yale School of Medicine, New Haven, Connecticut, USA. Hauptthemen laut MEDLINE: Digestive System Diseases, Neural Networks, Computer. Die Arbeit wurde bisher 58-mal zitiert (Crossref) und nennt 50 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NIDDK NIH HHS.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Large Language Models (LLMs) are transformer‐based neural networks with billions of parameters trained on very large text corpora from diverse sources. LLMs have the potential to improve healthcare due to their capability to parse complex concepts and generate context‐based responses. The interest in LLMs has not spared digestive disease academics, who have mainly investigated foundational LLM accuracy, which ranges from 25% to 90% and is influenced by the lack of standardized rules to report methodologies and results for LLM‐oriented research. In addition, a critical issue is the absence of a universally accepted definition of accuracy, varying from binary to scalar interpretations, often tied to grader expertise without reference to clinical guidelines. We address strategies and challenges to increase accuracy. In particular, LLMs can be infused with domain knowledge using Retrieval Augmented Generation (RAG) or Supervised Fine‐Tuning (SFT) with reinforcement learning from human feedback (RLHF). RAG faces challenges with in‐context window limits and accurate information retrieval from the provided context. SFT, a deeper adaptation method, is computationally demanding and requires specialized knowledge. LLMs may increase patient quality of care across the field of digestive diseases, where physicians are often engaged in screening, treatment and surveillance for a broad range of pathologies for which in‐context learning or SFT with RLHF could improve clinical decision‐making and patient outcomes. However, despite their potential, the safe deployment of LLMs in healthcare still needs to overcome hurdles in accuracy, suggesting a need for strategies that integrate human feedback with advanced model training.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Digestive System DiseasesNeural Networks, ComputerHumansNatural Language Processing

Stichwörter der Autor:innen

ChatGPTFine‐tuningIn‐context LearningLLMsLarge Language ModelsRHLFReinforcement Learning from Human FeedbackRetrieval Augmented GenerationSupervised Fine‐Tuning

Autor:innen und Institutionen

  • Department of Internal Medicine (Digestive Diseases), Yale School of Medicine, New Haven, Connecticut, USA.
  • Department of Medical, Surgical, and Health Sciences, University of Trieste, Trieste, Italy.
  • Department of Engineering and Architecture, University of Trieste, Trieste, Italy.
  • Division of Internal Medicine and Hepatology, Department of Gastroenterology, IRCCS Humanitas Research Hospital, Rozzano, Italy.
  • Department of Biomedical Sciences, Humanitas University, Pieve Emanuele, Italy.
  • Department of Mathematics, Baruch College, City University of New York, New York, New York, USA.

ORCID-Profile: Nicola Pugliese

Förderung

  • NIDDK NIH HHS

Zitieren

APA

Giuffrè, M., Kresevic, S., Pugliese, N., You, K., & Shung, D. L. (2024). Optimizing large language models in digestive disease: strategies and challenges to improve clinical outcomes. Liver International, 44(9), 2114-2124. https://doi.org/10.1111/liv.15974

Vancouver

Giuffrè M, Kresevic S, Pugliese N, You K, Shung DL. Optimizing large language models in digestive disease: strategies and challenges to improve clinical outcomes. Liver International. 2024;44(9):2114-2124. doi:10.1111/liv.15974

BibTeX
@article{Giuffr2024,
  author = {Giuffrè, Mauro and Kresevic, Simone and Pugliese, Nicola and You, Kisung and Shung, Dennis L},
  title = {Optimizing large language models in digestive disease: strategies and challenges to improve clinical outcomes},
  journal = {Liver International},
  year = {2024},
  volume = {44},
  number = {9},
  pages = {2114--2124},
  doi = {10.1111/liv.15974}
}
Kostenlos starten →