EUVIMEDEUVIMED entdecken
Crossref

Assessing Retrieval-Augmented Large Language Models for Medical Coding

Eyal Klang iD, Idit Tessler iD, Donald U Apakama iD, Ethan Abbott iD, Benjamin S Glicksberg iD, Monique Arnold iD, Akini Moses iD, Ankit Sakhuja iD, Ali Soroush iD, Alexander W Charney iD, David L Reich iD, Jolion McGreevy iD und 4 weitere

NEJM AI · 2025

DOI: 10.1056/aics2401161 ↗

Kurz gefasst

Fachartikel in der Zeitschrift NEJM AI, 2025. Verfasst von Eyal Klang und 15 weiteren Autor:innen. Beteiligte Einrichtung: The Windreich Department of Artificial Intelligence and Human Health, Mount Sinai, Medical Center, New York. Hauptthemen laut MEDLINE: Large Language Models, Clinical Coding. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 26 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

AbstractAccurate medical coding is vital for clinical and administrative purposes, but it is often complex and time-consuming. Large language models (LLMs) often struggle with medical coding, producing inaccuracies and hallucinations. We aimed to enhance LLM medical coding by integrating retrieval-augmented generation (RAG). We studied 500 randomly selected emergency department visits from the Mount Sinai Health System. Nine LLMs, both commercial and open-source, were evaluated for primary diagnosis coding according to the International Classification of Diseases, Tenth Revision, Clinical Modification. A RAG system enhanced LLM predictions using data from over 1 million emergency department visits. We compared RAG-enhanced codes with provider-assigned codes. A masked review by four physicians and two LLMs determined which codes - LLM- or provider-assigned - were more accurate and specific. RAG-enhanced LLMs demonstrated superior accuracy and specificity compared with provider-assigned codes. Human reviewers favored RAG-enhanced Generative Pretrained Transformer 4 (GPT-4) for accuracy in 447 instances, versus 277 instances for provider-assigned codes (P

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Large Language ModelsClinical CodingHumansEmergency Service, HospitalInternational Classification of DiseasesGenerative Artificial Intelligence

Autor:innen und Institutionen

  • The Windreich Department of Artificial Intelligence and Human Health, Mount Sinai, Medical Center, New York.
  • Charles Bronfman Institute for Personalized Medicine, Icahn School of Medicine at Mount Sinai, New York.
  • Department of Otolaryngology and Head and Neck Surgery, Sheba Medical Center, Ramat Gan, Israel.
  • Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel.
  • Department of Emergency Medicine, Icahn School of Medicine at Mount Sinai, New York.
  • Henry D. Janowitz Division of Gastroenterology, Icahn School of Medicine at Mount Sinai, New York.

ORCID-Profile: Eyal Klang, Idit Tessler, Donald U Apakama, Ethan Abbott, Benjamin S Glicksberg, Monique Arnold, Akini Moses, Ankit Sakhuja, Ali Soroush, Alexander W Charney, David L Reich, Jolion McGreevy, Nicholas Gavin, Brendan Carr, Robert Freeman, Girish N Nadkarni

Zitieren

APA

Klang, E., Tessler, I., Apakama, D. U., Abbott, E., Glicksberg, B. S., Arnold, M., Moses, A., Sakhuja, A., Soroush, A., Charney, A. W., Reich, D. L., McGreevy, J., Gavin, N., Carr, B., Freeman, R., & Nadkarni, G. N. (2025). Assessing Retrieval-Augmented Large Language Models for Medical Coding. NEJM AI. https://doi.org/10.1056/aics2401161

Vancouver

Klang E, Tessler I, Apakama DU, Abbott E, Glicksberg BS, Arnold M, et al. Assessing Retrieval-Augmented Large Language Models for Medical Coding. NEJM AI. 2025. doi:10.1056/aics2401161

BibTeX
@article{Klang2025,
  author = {Klang, Eyal and Tessler, Idit and Apakama, Donald U and Abbott, Ethan and Glicksberg, Benjamin S and Arnold, Monique and Moses, Akini and Sakhuja, Ankit and Soroush, Ali and Charney, Alexander W and Reich, David L and McGreevy, Jolion and Gavin, Nicholas and Carr, Brendan and Freeman, Robert and Nadkarni, Girish N},
  title = {Assessing Retrieval-Augmented Large Language Models for Medical Coding},
  journal = {NEJM AI},
  year = {2025},
  doi = {10.1056/aics2401161}
}
Kostenlos starten →