EUVIMEDEUVIMED entdecken
Crossref

CMedBench: A Comprehensive Benchmark for Efficient Medical Large Language Models

Shengbo Gao, Jinyang Guo, Lixian Su, Yifu Ding, Shiqiao Gu, Aishan Liu, Yuqing Ma, Zhiwang Zhang, Xianglong Liu

Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (25) · 21198-21206

DOI: 10.1609/aaai.v40i25.39264 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Shengbo Gao und 8 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Large Language Models (LLMs) hold significant potential for enhancing healthcare applications, yet their deployment is hindered by high computational and memory demands. Model compression techniques offer solutions to reduce these demands, but their impact on medical LLMs remains underexplored. In this paper, we introduce CMedBench, the first comprehensive benchmark for evaluating compressed LLMs in medical contexts. CMedBench assesses five core dimensions: Medical Knowledge Ability, Medical Application Ability, Trustworthiness Maintenance, Compression Cross Combination, and Computational Efficiency. Through extensive empirical studies, we analyze the trade-offs between model efficiency and clinical performance across diverse models, datasets, and compression strategies. Our findings highlight critical limitations in current evaluation practices and provide a robust framework for aligning compression strategies with medical requirements. CMedBench serves as a vital resource for researchers and practitioners, guiding the development of efficient, trustworthy, and clinically effective LLMs for healthcare applications.

Zitieren

APA

Gao, S., Guo, J., Su, L., Ding, Y., Gu, S., Liu, A., Ma, Y., Zhang, Z., & Liu, X. (2026). CMedBench: A Comprehensive Benchmark for Efficient Medical Large Language Models. Proceedings of the AAAI Conference on Artificial Intelligence, 40(25), 21198-21206. https://doi.org/10.1609/aaai.v40i25.39264

Vancouver

Gao S, Guo J, Su L, Ding Y, Gu S, Liu A, et al. CMedBench: A Comprehensive Benchmark for Efficient Medical Large Language Models. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(25):21198-21206. doi:10.1609/aaai.v40i25.39264

BibTeX
@article{Gao2026,
  author = {Gao, Shengbo and Guo, Jinyang and Su, Lixian and Ding, Yifu and Gu, Shiqiao and Liu, Aishan and Ma, Yuqing and Zhang, Zhiwang and Liu, Xianglong},
  title = {CMedBench: A Comprehensive Benchmark for Efficient Medical Large Language Models},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2026},
  volume = {40},
  number = {25},
  pages = {21198--21206},
  doi = {10.1609/aaai.v40i25.39264}
}
Kostenlos starten →