EUVIMEDEUVIMED entdecken
Studienprotokoll

Large language models as cost-conscious decision aids in emergency medicine: protocol support for imaging in lower back pain

Siona Prasad, Arya S Rao, Mario V Russo, Soham Ghoshal, Elizabeth Roux, Chau Vo, John Kim, Joshua A Hirsch, Michael H Lev, Rajiv Gupta, William H Marks, Amine Korchi und 5 weitere

Emergency Radiology · 2025

DOI: 10.1007/s10140-025-02412-8 ↗

Kurz gefasst

Studienprotokoll in der Zeitschrift Emergency Radiology, 2025. Verfasst von Siona Prasad und 16 weiteren Autor:innen. Beteiligte Einrichtung: Harvard Medical School, Boston, MA, USA. Hauptthemen laut MEDLINE: Low Back Pain, Emergency Service, Hospital, Magnetic Resonance Imaging, Decision Support Techniques. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 28 Literaturangaben. Gefördert von: NIGMS NIH HHS, National Institute of General Medical Sciences.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

BACKGROUND: Appropriate utilization of imaging in the emergency department (ED) remains an important determinant of health care expenditures and patient throughput. LLMs have demonstrated potential as clinical decision support tools, and may aid in cost-conscious imaging triage in the ED. We aim to evaluate the effectiveness of LLMs in providing accurate, cost-conscious imaging recommendations for ED patients with lower back pain. METHODS: 422 patients presented between December 2017 and June 2018 to the ED of a ~ 1000-bed major urban academic medical center with a chief complaint of lower back pain and received a lumbar spine MRI. The primary outcomes were Hoy et al. (Best Pract Res Clin Rheumatol 24(6):769-781, 2010) alignment of Generative Pre-Trained Transformer 4 (GPT-4)-generated imaging recommendations with ACR criteria, by raw accuracy and Cohen's κ, and Hoy et al. (Arthritis Rheum 64(6):2028-2037, 2012) professional service resource utilization quantified in work relative value units (wRVUs) under real-world clinical decisions, GPT-4 recommendations, and hypothetical 100% ACR adherence scenarios. GPT-4 was compared with real-world clinical decisions for imaging of lower back pain based on ED triage notes. Resource utilization was analyzed to assess potential savings from GPT-4 recommendations. RESULTS: GPT-4 model generated ACR-concordant recommendations for 72.0% (304/422) of cases and demonstrated significant alignment with ACR criteria as measured by Cohen's κ (0.42,95% CI: [0.35,0.48], p < 0.05). Actual resource utilization was 629 wRVUs. GPT-4 would have used 481.74 wRVUs. 100% adherence to the ACR criteria would have used 481.86 wRVUs. CONCLUSIONS: Our results support LLMs as possible tools for cost-conscious radiologic decision making in ED back pain evaluation.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Low Back PainEmergency Service, HospitalMagnetic Resonance ImagingDecision Support TechniquesHumansFemaleMaleMiddle AgedAdultLarge Language Models

Stichwörter der Autor:innen

Artificial intelligenceClinical decision supportCost-Conscious recommendationsEmergency departmentImaging triageLLMsLower back painResource utilization

Autor:innen und Institutionen

  • Harvard Medical School, Boston, MA, USA.
  • Medically Engineered Solutions in Healthcare Incubator, Innovation in Operations Research Center (MESH IO), Mass General Brigham, Boston, MA, USA.
  • Harvard Business School, Boston, MA, USA.
  • Massachusetts General Hospital, Boston, MA, USA.
  • Réseau Radiologique Romand, Région de Genève, Genève, Suisse.
  • Brown University Health, Providence, USA.

Förderung

  • NIGMS NIH HHS
  • National Institute of General Medical Sciences

Zitieren

APA

Prasad, S., Rao, A. S., Russo, M. V., Ghoshal, S., Roux, E., Vo, C., Kim, J., Hirsch, J. A., Lev, M. H., Gupta, R., Marks, W. H., Korchi, A., Landman, A., Bizzo, B. C., Raja, A. S., Dreyer, K. J., & Succi, M. D. (2025). Large language models as cost-conscious decision aids in emergency medicine: protocol support for imaging in lower back pain. Emergency Radiology. https://doi.org/10.1007/s10140-025-02412-8

Vancouver

Prasad S, Rao AS, Russo MV, Ghoshal S, Roux E, Vo C, et al. Large language models as cost-conscious decision aids in emergency medicine: protocol support for imaging in lower back pain. Emergency Radiology. 2025. doi:10.1007/s10140-025-02412-8

BibTeX
@article{Prasad2025,
  author = {Prasad, Siona and Rao, Arya S and Russo, Mario V and Ghoshal, Soham and Roux, Elizabeth and Vo, Chau and Kim, John and Hirsch, Joshua A and Lev, Michael H and Gupta, Rajiv and Marks, William H and Korchi, Amine and Landman, Adam and Bizzo, Bernardo C and Raja, Ali S and Dreyer, Keith J and Succi, Marc D},
  title = {Large language models as cost-conscious decision aids in emergency medicine: protocol support for imaging in lower back pain},
  journal = {Emergency Radiology},
  year = {2025},
  doi = {10.1007/s10140-025-02412-8}
}
Kostenlos starten →