Evaluating Clinical Reasoning and Diagnostic Performance of Multimodal Large Language Models in Benign Hematology—A Comparative Analysis
International Journal of Imaging Systems and Technology · 2026-07 · 36 (4)
DOI: 10.1002/ima.70409 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Imaging Systems and Technology, online erschienen am 11.07.2026. Verfasst von Zahra Rashid Khan und 7 weiteren Autor:innen. Die Arbeit nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Latest multimodal LLMs, capable of analyzing textual data and images. have potential application in decision support systems in diagnostics. Their performance and clinical reasoning abilities in benign hematology remain underexplored. This study evaluates and compares diagnostic performance and clinical reasoning of 3 LLM in classification of anemia, based on CBC triggers and peripheral blood smears, benchmarked with expert validated cases. A total of 270 LLM generated responses were evaluated for accuracy and clinical reasoning, using real world, expert validated anemia cases. LLMs (Gemini 2.5 Pro, Chat‐GPT4o and Claude Opus 4 Pro) were presented with focused prompt, digital image and CBC parameters as multimodal input. LLM accuracy scores and rubric‐derived clinical reasoning was calculated. Kruskal–Wallis H test was used to detect significant differences in clinical reasoning across LLMs, followed up with Dunn's Post Hoc Pairwise comparisons where indicated. Correlation between accuracy and clinical reasoning scores was evaluated using Spearman's correlation coefficient. Gemini 2.5 Pro showed the highest accuracy values (54%) among the three LLMs in Overall Accuracy, while Chat GPT 4o scored the lowest (38%). Class‐wise accuracies showed Claude Opus Pro 4 (76%) as the most accurate for Iron Deficiency Anemia and Gemini 2.5 (50%) for Hemoglobinopathy. There was a significant difference among LLMs in diagnosis of Hemoglobinopathy ( p = 0.016). A significant difference in clinical reasoning scores was noted across LLMs for Iron Deficiency Anemia (H statistic = 6.216, p = 0.0446). Post hoc pairwise comparisons revealed Gemini versus Claude pair to be statistically significant ( p = 0.040). A similar observation was made across LLM scores for the Hemoglobinopathy class (H statistic = 6.743, p = 0.0343). Post hoc pairwise comparisons revealed Gemini versus GPT‐4o pair to be statistically significant ( p = 0.0390) Additionally, Spearman correlation coefficient for accuracy versus clinical reasoning scores demonstrated consistently strong correlations across the three anemia subtypes for Gemini 2.5 Pro and Claude Opus 4. (ρ scores between 0.79 and 0.83), with GPT 4o showing modest correlation. While Gemini 2.5 Pro and Claude Opus 4 Pro perform relatively better among the three LLMs, their accuracy and clinical reasoning scores show only partial readiness for integration in Hematology training/teaching and workflows. These values should, however, be viewed as indicative rather than conclusive due to limited dataset. Although the results do provide insight but should be interpreted as preliminary and hypothesis‐generating.
Zitieren
APA
Khan, Z. R., Khan, K., Nayab, M., Akram, M. U., Ali, S., Shakoor, H. A., Haque, A., & Ahmed, M. (2026). Evaluating Clinical Reasoning and Diagnostic Performance of Multimodal Large Language Models in Benign Hematology—A Comparative Analysis. International Journal of Imaging Systems and Technology, 36(4). https://doi.org/10.1002/ima.70409
Vancouver
Khan ZR, Khan K, Nayab M, Akram MU, Ali S, Shakoor HA, et al. Evaluating Clinical Reasoning and Diagnostic Performance of Multimodal Large Language Models in Benign Hematology—A Comparative Analysis. International Journal of Imaging Systems and Technology. 2026;36(4). doi:10.1002/ima.70409
BibTeX
@article{Khan2026,
author = {Khan, Zahra Rashid and Khan, Kamran and Nayab, Maham and Akram, Muhammad Usman and Ali, Sundas and Shakoor, Huma Abdul and Haque, Ayesha and Ahmed, Meeral},
title = {Evaluating Clinical Reasoning and Diagnostic Performance of Multimodal Large Language Models in Benign Hematology—A Comparative Analysis},
journal = {International Journal of Imaging Systems and Technology},
year = {2026},
volume = {36},
number = {4},
doi = {10.1002/ima.70409}
}
EUVIMED