EUVIMEDEUVIMED entdecken
Crossref

Ultrasound Report Generation With Cross-Modality Feature Alignment via Unsupervised Guidance

Jun Li, Tongkun Su, Baoliang Zhao, Faqin Lv, Qiong Wang, Nassir Navab, Ying Hu, Zhongliang Jiang

IEEE Transactions on Medical Imaging · 2025-01 · 44 (1) · 19-30

DOI: 10.1109/tmi.2024.3424978 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Medical Imaging, 2025-01. Verfasst von Jun Li und 7 weiteren Autor:innen. Hauptthemen laut MEDLINE: Unsupervised Machine Learning, Image Interpretation, Computer-Assisted. Die Arbeit wurde bisher 25-mal zitiert (Crossref) und nennt 53 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Regional Joint Fund of Guangdong, Key Fundamental Research Program of Shenzhen.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Automatic report generation has arisen as a significant research area in computer-aided diagnosis, aiming to alleviate the burden on clinicians by generating reports automatically based on medical images. In this work, we propose a novel framework for automatic ultrasound report generation, leveraging a combination of unsupervised and supervised learning methods to aid the report generation process. Our framework incorporates unsupervised learning methods to extract potential knowledge from ultrasound text reports, serving as the prior information to guide the model in aligning visual and textual features, thereby addressing the challenge of feature discrepancy. Additionally, we design a global semantic comparison mechanism to enhance the performance of generating more comprehensive and accurate medical reports. To enable the implementation of ultrasound report generation, we constructed three large-scale ultrasound image-text datasets from different organs for training and validation purposes. Extensive evaluations with other state-of-the-art approaches exhibit its superior performance across all three datasets. Code and dataset are valuable at this link.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Unsupervised Machine LearningImage Interpretation, Computer-AssistedHumansUltrasonographyDatabases, FactualAlgorithmsSupervised Machine Learning

Förderung

  • National Natural Science Foundation of China
  • Regional Joint Fund of Guangdong
  • Key Fundamental Research Program of Shenzhen
  • Guangdong Provincial Key Laboratory of Computer Vision and Virtual Reality Technology, Shenzhen Institute of Advanced Technology

Zitieren

APA

Li, J., Su, T., Zhao, B., Lv, F., Wang, Q., Navab, N., Hu, Y., & Jiang, Z. (2025). Ultrasound Report Generation With Cross-Modality Feature Alignment via Unsupervised Guidance. IEEE Transactions on Medical Imaging, 44(1), 19-30. https://doi.org/10.1109/tmi.2024.3424978

Vancouver

Li J, Su T, Zhao B, Lv F, Wang Q, Navab N, et al. Ultrasound Report Generation With Cross-Modality Feature Alignment via Unsupervised Guidance. IEEE Transactions on Medical Imaging. 2025;44(1):19-30. doi:10.1109/tmi.2024.3424978

BibTeX
@article{Li2025,
  author = {Li, Jun and Su, Tongkun and Zhao, Baoliang and Lv, Faqin and Wang, Qiong and Navab, Nassir and Hu, Ying and Jiang, Zhongliang},
  title = {Ultrasound Report Generation With Cross-Modality Feature Alignment via Unsupervised Guidance},
  journal = {IEEE Transactions on Medical Imaging},
  year = {2025},
  volume = {44},
  number = {1},
  pages = {19--30},
  doi = {10.1109/tmi.2024.3424978}
}
Kostenlos starten →