EUVIMEDEUVIMED entdecken
Crossref

Uncertainty-Aware Medical Diagnostic Phrase Identification and Grounding

Ke Zou, Yang Bai, Bo Liu, Yidi Chen, Zhihao Chen, Yang Zhou, Xuedong Yuan, Meng Wang, Xiaojing Shen, Xiaochun Cao, Yih Chung Tham, Huazhu Fu

IEEE Transactions on Pattern Analysis and Machine Intelligence · 2025-12 · 47 (12) · 11315-11329

DOI: 10.1109/tpami.2025.3596878 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2025-12. Verfasst von Ke Zou und 11 weiteren Autor:innen. Hauptthemen laut MEDLINE: Natural Language Processing, Image Interpretation, Computer-Assisted. Die Arbeit wurde bisher 20-mal zitiert (Crossref) und nennt 54 Literaturangaben. Gefördert von: National Key Researchand Development Program of China, National Natural Science Foundation of China, H. Fu’s Agency for Science.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Medical phrase grounding is crucial for identifying relevant regions in medical images based on phrase queries, facilitating accurate image analysis and diagnosis. However, current methods rely on manual extraction of key phrases from medical reports, reducing efficiency and increasing the workload for clinicians. Additionally, the lack of model confidence estimation limits clinical trust and usability. In this paper, we introduce a novel task-Medical Report Grounding (MRG)-which aims to directly identify diagnostic phrases and their corresponding grounding boxes from medical reports in an end-to-end manner. To address this challenge, we propose uMedGround, a a robust and reliable framework that leverages a multimodal large language model to predict diagnostic phrases by embedding a unique token, , into the vocabulary to enhance detection capabilities. A vision encoder-decoder processes the embedded token and input image to generate grounding boxes. Critically, uMedGround incorporates an uncertainty-aware prediction model, significantly improving the robustness and reliability of grounding predictions. Experimental results demonstrate that uMedGround outperforms state-of-the-art medical phrase grounding methods and fine-tuned large visual-language models, validating its effectiveness and reliability. This study represents a pioneering exploration of the MRG task, marking the first-ever endeavor in this domain. Additionally, we demonstrate the applicability of uMedGround in medical visual question answering and class-based localization tasks, where it highlights visual evidence aligned with key diagnostic phrases, supporting clinicians in interpreting various types of textual inputs, including free-text reports, visual question answering queries, and class labels.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Natural Language ProcessingImage Interpretation, Computer-AssistedHumansUncertaintyAlgorithms

Förderung

  • National Key Researchand Development Program of China
  • National Natural Science Foundation of China
  • H. Fu’s Agency for Science
  • Technology and Research
  • Science and Technology Department of Sichuan Province
  • Science and Technology Department of Guangxi Zhuang Autonomous Region
  • Science and Technology Department of Hainan Province
  • National Research Foundation

Zitieren

APA

Zou, K., Bai, Y., Liu, B., Chen, Y., Chen, Z., Zhou, Y., Yuan, X., Wang, M., Shen, X., Cao, X., Tham, Y. C., & Fu, H. (2025). Uncertainty-Aware Medical Diagnostic Phrase Identification and Grounding. IEEE Transactions on Pattern Analysis and Machine Intelligence, 47(12), 11315-11329. https://doi.org/10.1109/tpami.2025.3596878

Vancouver

Zou K, Bai Y, Liu B, Chen Y, Chen Z, Zhou Y, et al. Uncertainty-Aware Medical Diagnostic Phrase Identification and Grounding. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2025;47(12):11315-11329. doi:10.1109/tpami.2025.3596878

BibTeX
@article{Zou2025,
  author = {Zou, Ke and Bai, Yang and Liu, Bo and Chen, Yidi and Chen, Zhihao and Zhou, Yang and Yuan, Xuedong and Wang, Meng and Shen, Xiaojing and Cao, Xiaochun and Tham, Yih Chung and Fu, Huazhu},
  title = {Uncertainty-Aware Medical Diagnostic Phrase Identification and Grounding},
  journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
  year = {2025},
  volume = {47},
  number = {12},
  pages = {11315--11329},
  doi = {10.1109/tpami.2025.3596878}
}
Kostenlos starten →