Exploring the feasibility of integrating ultra‐high field magnetic resonance imaging neuroimaging with multimodal artificial intelligence for clinical diagnostics
iRADIOLOGY · 2024
DOI: 10.1002/ird3.102 ↗At a glance
Journal article in iRADIOLOGY, 2024. Written by Yifan Yuan and 9 co-authors. Cited 5 times so far (Crossref); 22 references. The full text is freely available (open access, CC BY-NC 4.0). Funded by: Science and Technology Innovation Plan Of Shanghai Science and Technology Commission, National Natural Science Foundation of China.
Abstract (original language)
Background
The integration of 7 Tesla (7T) magnetic resonance imaging (MRI) with advanced multimodal artificial intelligence (AI) models represents a promising frontier in neuroimaging. The superior spatial resolution of 7TMRI provides detailed visualizations of brain structure, which are crucial forunderstanding complex central nervous system diseases and tumors. Concurrently, the application of multimodal AI to medical images enables interactive imaging‐based diagnostic conversation.
Methods
In this paper, we systematically investigate the capacity and feasibility of applying the existing advanced multimodal AI model ChatGPT‐4V to 7T MRI under the context of brain tumors. First, we test whether ChatGPT‐4V has knowledge about 7T MRI, and whether it can differentiate 7T MRI from 3T MRI. In addition, we explore whether ChatGPT‐4V can recognize different 7T MRI modalities and whether it can correctly offer diagnosis of tumors based on single or multiple modality 7T MRI.
Results
ChatGPT‐4V exhibited accuracy of 84.4% in 3T‐vs‐7T differentiation and accuracy of 78.9% in 7T modality recognition. Meanwhile, in a human evaluation with three clinical experts, ChatGPT obtained average scores of 9.27/20 in single modality‐based diagnosis and 21.25/25 in multiple modality‐based diagnosis. Our study indicates that single‐modality diagnosis and the interpretability of diagnostic decisions in clinical practice should be enhanced when ChatGPT‐4V is applied to 7T data.
Conclusions
In general, our analysis suggests that such integration has promise as a tool to improve the workflow of diagnostics in neurology, with a potentially transformative impact in the fields of medical image analysis and patient management.
Funding
- Science and Technology Innovation Plan Of Shanghai Science and Technology Commission
- National Natural Science Foundation of China
Cite
APA
Yuan, Y., Chen, K., Zhu, Y., Yu, Y., Hu, M., Chu, Y., Hsu, Y., Hu, J., Yue, Q., & Liu, M. (2024). Exploring the feasibility of integrating ultra‐high field magnetic resonance imaging neuroimaging with multimodal artificial intelligence for clinical diagnostics. iRADIOLOGY. https://doi.org/10.1002/ird3.102
Vancouver
Yuan Y, Chen K, Zhu Y, Yu Y, Hu M, Chu Y, et al. Exploring the feasibility of integrating ultra‐high field magnetic resonance imaging neuroimaging with multimodal artificial intelligence for clinical diagnostics. iRADIOLOGY. 2024. doi:10.1002/ird3.102
BibTeX
@article{Yuan2024,
author = {Yuan, Yifan and Chen, Kaitao and Zhu, Youjia and Yu, Yang and Hu, Mintao and Chu, Ying‐Hua and Hsu, Yi‐Cheng and Hu, Jie and Yue, Qi and Liu, Mianxin},
title = {Exploring the feasibility of integrating ultra‐high field magnetic resonance imaging neuroimaging with multimodal artificial intelligence for clinical diagnostics},
journal = {iRADIOLOGY},
year = {2024},
doi = {10.1002/ird3.102}
}
EUVIMED