EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Exploring the feasibility of integrating ultra‐high field magnetic resonance imaging neuroimaging with multimodal artificial intelligence for clinical diagnostics

Yifan Yuan, Kaitao Chen, Youjia Zhu, Yang Yu, Mintao Hu, Ying‐Hua Chu, Yi‐Cheng Hsu, Jie Hu, Qi Yue, Mianxin Liu

iRADIOLOGY · 2024

DOI: 10.1002/ird3.102 ↗

Kurz gefasst

Fachartikel in der Zeitschrift iRADIOLOGY, 2024. Verfasst von Yifan Yuan und 9 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 22 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: Science and Technology Innovation Plan Of Shanghai Science and Technology Commission, National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

The integration of 7 Tesla (7T) magnetic resonance imaging (MRI) with advanced multimodal artificial intelligence (AI) models represents a promising frontier in neuroimaging. The superior spatial resolution of 7TMRI provides detailed visualizations of brain structure, which are crucial forunderstanding complex central nervous system diseases and tumors. Concurrently, the application of multimodal AI to medical images enables interactive imaging‐based diagnostic conversation.

Methods

In this paper, we systematically investigate the capacity and feasibility of applying the existing advanced multimodal AI model ChatGPT‐4V to 7T MRI under the context of brain tumors. First, we test whether ChatGPT‐4V has knowledge about 7T MRI, and whether it can differentiate 7T MRI from 3T MRI. In addition, we explore whether ChatGPT‐4V can recognize different 7T MRI modalities and whether it can correctly offer diagnosis of tumors based on single or multiple modality 7T MRI.

Results

ChatGPT‐4V exhibited accuracy of 84.4% in 3T‐vs‐7T differentiation and accuracy of 78.9% in 7T modality recognition. Meanwhile, in a human evaluation with three clinical experts, ChatGPT obtained average scores of 9.27/20 in single modality‐based diagnosis and 21.25/25 in multiple modality‐based diagnosis. Our study indicates that single‐modality diagnosis and the interpretability of diagnostic decisions in clinical practice should be enhanced when ChatGPT‐4V is applied to 7T data.

Conclusions

In general, our analysis suggests that such integration has promise as a tool to improve the workflow of diagnostics in neurology, with a potentially transformative impact in the fields of medical image analysis and patient management.

Förderung

  • Science and Technology Innovation Plan Of Shanghai Science and Technology Commission
  • National Natural Science Foundation of China

Zitieren

APA

Yuan, Y., Chen, K., Zhu, Y., Yu, Y., Hu, M., Chu, Y., Hsu, Y., Hu, J., Yue, Q., & Liu, M. (2024). Exploring the feasibility of integrating ultra‐high field magnetic resonance imaging neuroimaging with multimodal artificial intelligence for clinical diagnostics. iRADIOLOGY. https://doi.org/10.1002/ird3.102

Vancouver

Yuan Y, Chen K, Zhu Y, Yu Y, Hu M, Chu Y, et al. Exploring the feasibility of integrating ultra‐high field magnetic resonance imaging neuroimaging with multimodal artificial intelligence for clinical diagnostics. iRADIOLOGY. 2024. doi:10.1002/ird3.102

BibTeX
@article{Yuan2024,
  author = {Yuan, Yifan and Chen, Kaitao and Zhu, Youjia and Yu, Yang and Hu, Mintao and Chu, Ying‐Hua and Hsu, Yi‐Cheng and Hu, Jie and Yue, Qi and Liu, Mianxin},
  title = {Exploring the feasibility of integrating ultra‐high field magnetic resonance imaging neuroimaging with multimodal artificial intelligence for clinical diagnostics},
  journal = {iRADIOLOGY},
  year = {2024},
  doi = {10.1002/ird3.102}
}
Kostenlos starten →