EUVIMEDEUVIMED entdecken
Crossref

MIRA: Evaluating Multimodal AI on Complex Clinical Reasoning in Interventional Radiology

Jingxiong Li, Chenglu Zhu, Sunyi Zheng, Yuxuan Sun, Yifei Wang, He Liu, Yunlong Zhang, Yixuan Si, Lin Yang, Liang Xiao

Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (8) · 6235-6243

DOI: 10.1609/aaai.v40i8.37549 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Jingxiong Li und 9 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

We present MIRA (Multimodal Interventional RAdiology evaluation), a comprehensive benchmark for evaluating large multimodal models in expert-level interventional radiology tasks requiring specialized domain knowledge and advanced visual reasoning capabilities. Unlike existing medical benchmarks that primarily provide binary labels without contextual depth, MIRA offers diverse question formats, including open-ended, closed-ended, single-choice, and multiple-choice categories, each accompanied by detailed expert-validated explanations. The benchmark incorporates approximately 184K high-quality medical images spanning multiple imaging modalities with 1.2M meticulously generated question-answer pairs across various anatomical regions. These pairs were created through a sophisticated cascade methodology involving expert interventional radiologists at both the data collection and validation stages. Our comprehensive evaluation, encompassing zero-shot testing and fine-tuning experiments of large multimodal models, revealing significant performance gaps between AI systems and human specialists. Fine-tuning experiments demonstrate substantial improvements, with models achieving up to 0.80 accuracy on single-choice questions. MIRA establishes a challenging benchmark that suggests promising directions for developing specialized clinical AI systems for interventional radiology.

Zitieren

APA

Li, J., Zhu, C., Zheng, S., Sun, Y., Wang, Y., Liu, H., Zhang, Y., Si, Y., Yang, L., & Xiao, L. (2026). MIRA: Evaluating Multimodal AI on Complex Clinical Reasoning in Interventional Radiology. Proceedings of the AAAI Conference on Artificial Intelligence, 40(8), 6235-6243. https://doi.org/10.1609/aaai.v40i8.37549

Vancouver

Li J, Zhu C, Zheng S, Sun Y, Wang Y, Liu H, et al. MIRA: Evaluating Multimodal AI on Complex Clinical Reasoning in Interventional Radiology. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(8):6235-6243. doi:10.1609/aaai.v40i8.37549

BibTeX
@article{Li2026,
  author = {Li, Jingxiong and Zhu, Chenglu and Zheng, Sunyi and Sun, Yuxuan and Wang, Yifei and Liu, He and Zhang, Yunlong and Si, Yixuan and Yang, Lin and Xiao, Liang},
  title = {MIRA: Evaluating Multimodal AI on Complex Clinical Reasoning in Interventional Radiology},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2026},
  volume = {40},
  number = {8},
  pages = {6235--6243},
  doi = {10.1609/aaai.v40i8.37549}
}
Kostenlos starten →