EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Multimodal deep learning with MUF-net for noninvasive WHO/ISUP grading of renal cell carcinoma using CEUS and B-mode ultrasound

Yixin Zhu, Ji Wu, Qiongxian Long, Yan Li, Hao Luo, Lu Pang, Lin Zhu, Hui Luo

Frontiers in Physiology · 07.03.2025 · 16

DOI: 10.3389/fphys.2025.1558997 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Frontiers in Physiology, online erschienen am 07.03.2025. Verfasst von Yixin Zhu und 7 weiteren Autor:innen. Beteiligte Einrichtung: Department of Ultrasound, Peking University Shenzhen Hospital, Shenzhen, Guangdong, China. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 26 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Objective

This study aimed to develop and validate a multimodal deep learning model that utilizes preoperative grayscale and contrast-enhanced ultrasound (CEUS) video data for noninvasive WHO/ISUP nuclear grading of renal cell carcinoma (RCC).

Methods

In this dual-center retrospective study, CEUS videos from 100 patients with RCC collected between June 2012 and June 2021 were analyzed. A total of 6,293 ultrasound images were categorized into low-grade (G1-G2) and high-grade (G3-G4) groups. A novel model, the Multimodal Ultrasound Fusion Network (MUF-Net), integrated B-mode and CEUS modalities to extract and fuse image features using a weighted sum of predicted weights. Model performance was assessed using five-fold cross-validation and compared to single-modality models. Grad-CAM visualization highlighted key regions influencing the model’s predictions.

Results

MUF-Net achieved an accuracy of 85.9%, outperforming B-mode (80.8%) and CEUS-mode (81.8%, P < 0.05) models. Sensitivities were 85.1%, 80.2%, and 77.8%, while specificities were 86.0%, 82.5%, and 82.7%, respectively. The AUC of MUF-Net (0.909, 95% CI: 0.829-0.990) was superior to B-mode (0.838, 95% CI: 0.689-0.988) and CEUS-mode (0.845, 95% CI: 0.745-0.944). Grad-CAM analysis revealed distinct and complementary salient regions across modalities.

Conclusion

MUF-Net provides accurate and interpretable RCC nuclear grading, surpassing unimodal approaches, with Grad-CAM offering intuitive insights into the model’s predictions.

Schlagwörter

Stichwörter der Autor:innen

WHO/ISUP grading systemartificial intelligenceclassificationcontrast-enhanced ultrasounddeep learningrenal tumor

Autor:innen und Institutionen

  • Department of Ultrasound, Peking University Shenzhen Hospital, Shenzhen, Guangdong, China.
  • Department of Urology, The Affiliated Nanchong Central Hospital of North Sichuan Medical College, Nanchong, Sichuan, China.
  • Department of Pathology, The Affiliated Nanchong Central Hospital of North Sichuan Medical College, Nanchong, Sichuan, China.
  • Department of Ultrasound, The Affiliated Nanchong Central Hospital of North Sichuan Medical College, Nanchong, Sichuan, China.
  • Department of Clinical and Research, Shenzhen Mindray Bio-medical Electronics Co., Ltd., Shenzhen, China.
  • Department of Ultrasound, The Second Clinical Medical College, Jinan University (Shenzhen People's Hospital), Shenzhen, Guangdong, China.

Zitieren

APA

Zhu, Y., Wu, J., Long, Q., Li, Y., Luo, H., Pang, L., Zhu, L., & Luo, H. (2025). Multimodal deep learning with MUF-net for noninvasive WHO/ISUP grading of renal cell carcinoma using CEUS and B-mode ultrasound. Frontiers in Physiology, 16. https://doi.org/10.3389/fphys.2025.1558997

Vancouver

Zhu Y, Wu J, Long Q, Li Y, Luo H, Pang L, et al. Multimodal deep learning with MUF-net for noninvasive WHO/ISUP grading of renal cell carcinoma using CEUS and B-mode ultrasound. Frontiers in Physiology. 2025;16. doi:10.3389/fphys.2025.1558997

BibTeX
@article{Zhu2025,
  author = {Zhu, Yixin and Wu, Ji and Long, Qiongxian and Li, Yan and Luo, Hao and Pang, Lu and Zhu, Lin and Luo, Hui},
  title = {Multimodal deep learning with MUF-net for noninvasive WHO/ISUP grading of renal cell carcinoma using CEUS and B-mode ultrasound},
  journal = {Frontiers in Physiology},
  year = {2025},
  volume = {16},
  doi = {10.3389/fphys.2025.1558997}
}
Kostenlos starten →