Evaluating large language models and agents in healthcare: key challenges in clinical applications
Intelligent Medicine · 2025-05 · 5 (2) · 151-163
DOI: 10.1016/j.imed.2025.03.002 ↗Kurz gefasst
Fachartikel in der Zeitschrift Intelligent Medicine, 2025-05. Verfasst von Xiaolan Chen und 5 weiteren Autor:innen. Die Arbeit wurde bisher 89-mal zitiert (Crossref) und nennt 133 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: The Hong Kong Polytechnic University.
Abstract (Originalsprache)
Large language models (LLMs) have emerged as transformative tools with significant potential across healthcare and medicine. In clinical settings, they hold promises for tasks ranging from clinical decision support to patient education. Advances in LLM agents further broaden their utility by enabling multimodal processing and multitask handling in complex clinical workflows. However, evaluating the performance of LLMs in medical contexts presents unique challenges due to the high-risk nature of healthcare and the complexity of medical data. This paper provides a comprehensive overview of current evaluation practices for LLMs and LLM agents in medicine. We contributed 3 main aspects: First, we summarized data sources used in evaluations, including existing medical resources and manually designed clinical questions, offering a basis for LLM evaluation in medical settings. Second, we analyzed key medical task scenarios: closed-ended tasks, open-ended tasks, image processing tasks, and real-world multitask scenarios involving LLM agents, thereby offering guidance for further research across different medical applications. Third, we compared evaluation methods and dimensions, covering both automated metrics and human expert assessments, while addressing traditional accuracy measures alongside agent-specific dimensions, such as tool usage and reasoning capabilities. Finally, we identified key challenges and opportunities in this evolving field, emphasizing the need for continued research and interdisciplinary collaboration between healthcare professionals and computer scientists to ensure safe, ethical, and effective deployment of LLMs in clinical practice.
Förderung
- The Hong Kong Polytechnic University
Zitieren
APA
Chen, X., Xiang, J., Lu, S., Liu, Y., He, M., & Shi, D. (2025). Evaluating large language models and agents in healthcare: key challenges in clinical applications. Intelligent Medicine, 5(2), 151-163. https://doi.org/10.1016/j.imed.2025.03.002
Vancouver
Chen X, Xiang J, Lu S, Liu Y, He M, Shi D. Evaluating large language models and agents in healthcare: key challenges in clinical applications. Intelligent Medicine. 2025;5(2):151-163. doi:10.1016/j.imed.2025.03.002
BibTeX
@article{Chen2025,
author = {Chen, Xiaolan and Xiang, Jiayang and Lu, Shanfu and Liu, Yexin and He, Mingguang and Shi, Danli},
title = {Evaluating large language models and agents in healthcare: key challenges in clinical applications},
journal = {Intelligent Medicine},
year = {2025},
volume = {5},
number = {2},
pages = {151--163},
doi = {10.1016/j.imed.2025.03.002}
}
EUVIMED