EUVIMEDEUVIMED entdecken
Open Access

Deep Learning for Content-Based Medical Image Retrieval in Picture Archiving and Communication Systems for Brain Tumor Detection: Algorithm Development and Validation

Chin-Lin Lee iD, Tzu-Hsuan Hsu iD, Yu-Te Wu iD, Wan-Yuo Guo iD, Woei-Chyn Chu iD, Chung-Yueh Lien iD

JMIR Medical Informatics · 06.04.2026 · 14 · e78300-e78300

DOI: 10.2196/78300 ↗

Kurz gefasst

Fachartikel in der Zeitschrift JMIR Medical Informatics, online erschienen am 06.04.2026. Verfasst von Chin-Lin Lee und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Information Management, National Taipei University of Nursing and Health Science, No. 365, Ming-te Rd, Beitou Dist, Taipei City, 112303…. Hauptthemen laut MEDLINE: Brain Neoplasms, Deep Learning, Radiology Information Systems, Algorithms. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Advances in medical imaging have led to massive archives, yet navigating these datasets remains challenging due to the limitations of traditional text-based search engines. While content-based medical image retrieval (CBMIR) offers a visual feature–based solution to enhance clinical workflows and research, its operational integration into picture archiving and communication systems (PACS) remains a significant bottleneck. Despite the progress in deep learning for feature extraction, CBMIR tools are rarely integrated and effectively implemented within existing radiology information systems due to complex protocol barriers.

Objective

To address these challenges, this study develops a CBMIR system meticulously designed to cater to 7 distinct types of brain tumors as seen in brain magnetic resonance images. Our system is tailored to assist radiologists and health care professionals in efficiently retrieving pertinent historical medical images, thereby providing quantitative decision support for radiologists and facilitating evidence-based case comparison, with the potential to improve retrieval efficiency and clinical workflow, rather than directly enhancing diagnostic accuracy.

Methods

The dataset used in this study was collected from a single medical center and is not publicly available. The core innovation is a state-of-the-art deep learning–based feature extraction algorithm specifically engineered for the CBMIR system. We use GoogLeNet as the primary architecture, incorporating generalized mean pooling to capture nuanced local features and an embedding layer for dimension reduction. Crucially, we address the integration gap by harmonizing 2 open-source projects to successfully embed the CBMIR system into a functional PACS environment via standard protocols.

Results

The image dataset contains 658 participants with 15,873 images collected from 2000 to 2017. The empirical findings of our research demonstrate the performance and robustness of the proposed CBMIR system. Our system achieves a remarkable mean average precision score of 89.16% and an equally impressive Precision@10 score of 94.08%. These metrics affirm the system’s efficacy in retrieving relevant medical images. Furthermore, we successfully integrate the CBMIR system into a PACS by successfully harmonizing 2 open-source projects.

Conclusions

This study presents the design and implementation of a PACS-integrated CBMIR system for brain magnetic resonance imaging, and the experimental results demonstrate that the system can achieve efficient and accurate image retrieval within a clinical workflow.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Brain NeoplasmsDeep LearningRadiology Information SystemsAlgorithmsInformation Storage and RetrievalHumansMagnetic Resonance Imaging

Stichwörter der Autor:innen

CBMIRDICOMDigital Imaging and Communications in MedicinePACSbrain tumorcontent-based medical image retrievaldeep learningpicture archiving and communication systemtumor

Autor:innen und Institutionen

  • Department of Information Management, National Taipei University of Nursing and Health Science, No. 365, Ming-te Rd, Beitou Dist, Taipei City, 112303, Taiwan, +886 2-2822-7101 ext 1230.
  • Institute of Biophotonics, National Yang Ming Chiao Tung University, Taipei, Taiwan.
  • Department of Radiology, Taipei Veterans General Hospital, Taipei, Taiwan.
  • Department of Biomedical Engineering, National Yang Ming Chiao Tung University, Taipei, Taiwan.

ORCID-Profile: Chin-Lin Lee, Tzu-Hsuan Hsu, Yu-Te Wu, Wan-Yuo Guo, Woei-Chyn Chu, Chung-Yueh Lien

Zitieren

APA

Lee, C. L., Hsu, T. H., Wu, Y. T., Guo, W. Y., Chu, W. C., & Lien, C. Y. (2026). Deep Learning for Content-Based Medical Image Retrieval in Picture Archiving and Communication Systems for Brain Tumor Detection: Algorithm Development and Validation. JMIR Medical Informatics, 14, e78300-e78300. https://doi.org/10.2196/78300

Vancouver

Lee CL, Hsu TH, Wu YT, Guo WY, Chu WC, Lien CY. Deep Learning for Content-Based Medical Image Retrieval in Picture Archiving and Communication Systems for Brain Tumor Detection: Algorithm Development and Validation. JMIR Medical Informatics. 2026;14:e78300-e78300. doi:10.2196/78300

BibTeX
@article{Lee2026,
  author = {Lee, Chin-Lin and Hsu, Tzu-Hsuan and Wu, Yu-Te and Guo, Wan-Yuo and Chu, Woei-Chyn and Lien, Chung-Yueh},
  title = {Deep Learning for Content-Based Medical Image Retrieval in Picture Archiving and Communication Systems for Brain Tumor Detection: Algorithm Development and Validation},
  journal = {JMIR Medical Informatics},
  year = {2026},
  volume = {14},
  pages = {e78300--e78300},
  doi = {10.2196/78300}
}
Kostenlos starten →