Multimodal reasoning agent for enhanced ophthalmic decision-making: a preliminary real-world clinical validation
Frontiers in Cell and Developmental Biology · 23.07.2025 · 13
DOI: 10.3389/fcell.2025.1642539 ↗Kurz gefasst
Fachartikel in der Zeitschrift Frontiers in Cell and Developmental Biology, online erschienen am 23.07.2025. Verfasst von Yijing Zhuang und 7 weiteren Autor:innen. Beteiligte Einrichtung: Shenzhen Eye Hospital, Shenzhen Eye Institute, Jinan University, Shenzhen, Guangdong, China. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Shenzhen Science and Technology Innovation Program, Basic and Applied Basic Research Foundation of Guangdong Province.
Abstract (Originalsprache)
Although large language models (LLMs) show significant potential in clinical practice, accurate diagnosis and treatment planning in ophthalmology require multimodal integration of imaging, clinical history, and guideline-based knowledge. Current LLMs predominantly focus on unimodal language tasks and face limitations in specialized ophthalmic diagnosis due to domain knowledge gaps, hallucination risks, and inadequate alignment with clinical workflows. This study introduces a structured reasoning agent (ReasonAgent) that integrates a multimodal visual analysis module, a knowledge retrieval module, and a diagnostic reasoning module to address the limitations of current AI systems in ophthalmic decision-making. Validated on 30 real-world ophthalmic cases (27 common and 3 rare diseases), ReasonAgent demonstrated diagnostic accuracy comparable to ophthalmology residents ( β = −0.07, p = 0.65). However, in treatment planning, it significantly outperformed both GPT-4o ( β = 0.49, p = 0.01) and residents ( β = 1.71, p < 0.001), particularly excelling in rare disease scenarios (all p < 0.05). While GPT-4o showed vulnerabilities in rare cases (90.48% low diagnostic scores), ReasonAgent’s hybrid design mitigated errors through structured reasoning. Statistical analysis identified significant case-level heterogeneity (diagnosis ICC = 0.28), highlighting the need for domain-specific AI solutions in complex clinical contexts. This framework establishes a novel paradigm for domain-specific AI in real-world clinical practice, demonstrating the potential of modularized architectures to advance decision fidelity through human-aligned reasoning pathways.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Shenzhen Eye Hospital, Shenzhen Eye Institute, Jinan University, Shenzhen, Guangdong, China.
Förderung
- Shenzhen Science and Technology Innovation Program
- Basic and Applied Basic Research Foundation of Guangdong Province
Zitieren
APA
Zhuang, Y., Fang, D., Li, P., Bai, B., Hei, X., Feng, L., Li, W., & Zhang, S. (2025). Multimodal reasoning agent for enhanced ophthalmic decision-making: a preliminary real-world clinical validation. Frontiers in Cell and Developmental Biology, 13. https://doi.org/10.3389/fcell.2025.1642539
Vancouver
Zhuang Y, Fang D, Li P, Bai B, Hei X, Feng L, et al. Multimodal reasoning agent for enhanced ophthalmic decision-making: a preliminary real-world clinical validation. Frontiers in Cell and Developmental Biology. 2025;13. doi:10.3389/fcell.2025.1642539
BibTeX
@article{Zhuang2025,
author = {Zhuang, Yijing and Fang, Dong and Li, Pengfeng and Bai, Bingyu and Hei, Xiangqing and Feng, Lujia and Li, Wangting and Zhang, Shaochong},
title = {Multimodal reasoning agent for enhanced ophthalmic decision-making: a preliminary real-world clinical validation},
journal = {Frontiers in Cell and Developmental Biology},
year = {2025},
volume = {13},
doi = {10.3389/fcell.2025.1642539}
}
EUVIMED