Assessing Retrieval-Augmented Large Language Models for Medical Coding
NEJM AI · 2025
DOI: 10.1056/aics2401161 ↗Kurz gefasst
Fachartikel in der Zeitschrift NEJM AI, 2025. Verfasst von Eyal Klang und 15 weiteren Autor:innen. Beteiligte Einrichtung: The Windreich Department of Artificial Intelligence and Human Health, Mount Sinai, Medical Center, New York. Hauptthemen laut MEDLINE: Large Language Models, Clinical Coding. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 26 Literaturangaben.
Abstract (Originalsprache)
AbstractAccurate medical coding is vital for clinical and administrative purposes, but it is often complex and time-consuming. Large language models (LLMs) often struggle with medical coding, producing inaccuracies and hallucinations. We aimed to enhance LLM medical coding by integrating retrieval-augmented generation (RAG). We studied 500 randomly selected emergency department visits from the Mount Sinai Health System. Nine LLMs, both commercial and open-source, were evaluated for primary diagnosis coding according to the International Classification of Diseases, Tenth Revision, Clinical Modification. A RAG system enhanced LLM predictions using data from over 1 million emergency department visits. We compared RAG-enhanced codes with provider-assigned codes. A masked review by four physicians and two LLMs determined which codes - LLM- or provider-assigned - were more accurate and specific. RAG-enhanced LLMs demonstrated superior accuracy and specificity compared with provider-assigned codes. Human reviewers favored RAG-enhanced Generative Pretrained Transformer 4 (GPT-4) for accuracy in 447 instances, versus 277 instances for provider-assigned codes (P
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- The Windreich Department of Artificial Intelligence and Human Health, Mount Sinai, Medical Center, New York.
- Charles Bronfman Institute for Personalized Medicine, Icahn School of Medicine at Mount Sinai, New York.
- Department of Otolaryngology and Head and Neck Surgery, Sheba Medical Center, Ramat Gan, Israel.
- Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel.
- Department of Emergency Medicine, Icahn School of Medicine at Mount Sinai, New York.
- Henry D. Janowitz Division of Gastroenterology, Icahn School of Medicine at Mount Sinai, New York.
ORCID-Profile: Eyal Klang, Idit Tessler, Donald U Apakama, Ethan Abbott, Benjamin S Glicksberg, Monique Arnold, Akini Moses, Ankit Sakhuja, Ali Soroush, Alexander W Charney, David L Reich, Jolion McGreevy, Nicholas Gavin, Brendan Carr, Robert Freeman, Girish N Nadkarni
Zitieren
APA
Klang, E., Tessler, I., Apakama, D. U., Abbott, E., Glicksberg, B. S., Arnold, M., Moses, A., Sakhuja, A., Soroush, A., Charney, A. W., Reich, D. L., McGreevy, J., Gavin, N., Carr, B., Freeman, R., & Nadkarni, G. N. (2025). Assessing Retrieval-Augmented Large Language Models for Medical Coding. NEJM AI. https://doi.org/10.1056/aics2401161
Vancouver
Klang E, Tessler I, Apakama DU, Abbott E, Glicksberg BS, Arnold M, et al. Assessing Retrieval-Augmented Large Language Models for Medical Coding. NEJM AI. 2025. doi:10.1056/aics2401161
BibTeX
@article{Klang2025,
author = {Klang, Eyal and Tessler, Idit and Apakama, Donald U and Abbott, Ethan and Glicksberg, Benjamin S and Arnold, Monique and Moses, Akini and Sakhuja, Ankit and Soroush, Ali and Charney, Alexander W and Reich, David L and McGreevy, Jolion and Gavin, Nicholas and Carr, Brendan and Freeman, Robert and Nadkarni, Girish N},
title = {Assessing Retrieval-Augmented Large Language Models for Medical Coding},
journal = {NEJM AI},
year = {2025},
doi = {10.1056/aics2401161}
}
EUVIMED