Applying vision transformer to assess multi-scale morphological features in mammography for breast cancer detection: multiscale image morphological extraction vision transformer (MIME-ViT)
PeerJ Computer Science · 15.10.2025 · 11 · e3252
DOI: 10.7717/peerj-cs.3252 ↗Kurz gefasst
Fachartikel in der Zeitschrift PeerJ Computer Science, online erschienen am 15.10.2025. Verfasst von Yuki Kashiwada und 7 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 41 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: JST, JSPS KAKENHI, MEXT/JSPS WISE Program.
Abstract (Originalsprache)
Background
Breast cancer screening using mammography often suffers from low sensitivity and specificity, particularly in dense breast tissue. This limitation can result in missed diagnoses and unnecessary procedures. The evolution of deep learning models, such as those based on convulational neural networks (CNNs) and Vision Transformers (ViTs), presents opportunities for significant advancements.
Methods
This study utilized the Chinese Mammography Database (CMMD) and enhanced it with detailed annotations from two radiologists for detection tasks. The Multiscale Image Morphological Extraction Vision Transformer (MIME-ViT) model, which integrates ViT and CNN, is designed to capture multiscale morphological features from mammographic images. Training of the model prioritized segmentation and classification, employing a combination of Dice and Focal losses to effectively tackle detection tasks.
Results
Without pre-training, MIME-ViT achieved a mean Intersection over Union (IoU) of 0.3342 across all images, 0.3797 for mass, and 0.2491 for calcification. In terms of IoU scores, MIME-ViT’s performance was inferior to that of Detection Transformer (DETR) with pre-training, yet it surpassed the performance of DETR without pre-training.
Conclusions
By merging Vision Transformers with CNNs to enhance mammographic imaging analysis, the MIME-ViT model represents a significant advancement in breast cancer detection. This development marks a critical step forward in medical imaging technology, with the goal of improving early detection rates and patient outcomes. As medical imaging technology continues to evolve, MIME-ViT emerges as a key innovation, paving the way for more effective and advanced cancer screening methodologies.
Förderung
- JST
- JSPS KAKENHI
- MEXT/JSPS WISE Program
Zitieren
APA
Kashiwada, Y., Takaya, E., Hiroya, M., Matsuda, N., Yashima, T., Kobayashi, T., Tamiya, G., & Ueda, T. (2025). Applying vision transformer to assess multi-scale morphological features in mammography for breast cancer detection: multiscale image morphological extraction vision transformer (MIME-ViT). PeerJ Computer Science, 11, e3252. https://doi.org/10.7717/peerj-cs.3252
Vancouver
Kashiwada Y, Takaya E, Hiroya M, Matsuda N, Yashima T, Kobayashi T, et al. Applying vision transformer to assess multi-scale morphological features in mammography for breast cancer detection: multiscale image morphological extraction vision transformer (MIME-ViT). PeerJ Computer Science. 2025;11:e3252. doi:10.7717/peerj-cs.3252
BibTeX
@article{Kashiwada2025,
author = {Kashiwada, Yuki and Takaya, Eichi and Hiroya, Mei and Matsuda, Nanako and Yashima, Takumi and Kobayashi, Tomoya and Tamiya, Gen and Ueda, Takuya},
title = {Applying vision transformer to assess multi-scale morphological features in mammography for breast cancer detection: multiscale image morphological extraction vision transformer (MIME-ViT)},
journal = {PeerJ Computer Science},
year = {2025},
volume = {11},
pages = {e3252},
doi = {10.7717/peerj-cs.3252}
}
EUVIMED