Hybrid transformer‐based model for mammogram classification by integrating prior and current images
Medical Physics · 2025-05 · 52 (5) · 2999-3014
DOI: 10.1002/mp.17650 ↗At a glance
Journal article in Medical Physics, published online on 2025-01-30. Written by Afsana Ahsan Jeny and 7 co-authors. Institution: School of Computing, University of Connecticut, Storrs, Connecticut, USA. Major MEDLINE topics: Mammography, Breast Neoplasms, Image Processing, Computer-Assisted, Neural Networks, Computer. Cited 21 times so far (Crossref); 55 references. The full text is freely available in PubMed Central. Funded by: NCI NIH HHS, University of Connecticut.
Abstract (original language)
Background
Breast cancer screening via mammography plays a crucial role in early detection, significantly impacting women's health outcomes worldwide. However, the manual analysis of mammographic images is time‐consuming and requires specialized expertise, presenting substantial challenges in medical practice.
Purpose
To address these challenges, we introduce a CNN‐Transformer based model tailored for breast cancer classification through mammographic analysis. This model leverages both prior and current images to monitor temporal changes, aiming to enhance the efficiency and accuracy (ACC) of computer‐aided diagnosis systems by mimicking the detailed examination process of radiologists.
Methods
In this study, our proposed model incorporates a novel integration of a position‐wise feedforward network and multi‐head self‐attention, enabling it to detect abnormal or cancerous changes in mammograms over time. Additionally, the model employs positional encoding and channel attention methods to accurately highlight critical spatial features, thus precisely differentiating between normal and cancerous tissues. Our methodology utilizes focal loss (FL) to precisely address challenging instances that are difficult to classify, reducing false negatives and false positives to improve diagnostic ACC.
Results
We compared our model with eight baseline models; specifically, we utilized only current images for the single model ResNet50 while employing both prior and current images for the remaining models in terms of accuracy (ACC), sensitivity (SEN), precision (PRE), specificity (SPE), F1 score, and area under the curve (AUC). The results demonstrate that the proposed model outperforms the baseline models, achieving an ACC of 90.80%, SEN of 90.80%, PRE of 90.80%, SPE of 90.88%, an F1 score of 90.95%, and an AUC of 92.58%. The codes and related information are available at https://github.com/NabaviLab/PCTM .
Conclusions
Our proposed CNN‐Transformer model integrates both prior and current images, removes long‐range dependencies, and enhances its capability for nuanced classification. The application of FL reduces false positive rate (FPR) and false negative rates (FNR), improving both SEN and SPE. Furthermore, the model achieves the lowest false discovery rate and FNR across various abnormalities, including masses, calcification, and architectural distortions (ADs). These low error rates highlight the model's reliability and underscore its potential to improve early breast cancer detection in clinical practice.
Subjects
MeSH terms (MEDLINE)
Author keywords
Authors and institutions
- School of Computing, University of Connecticut, Storrs, Connecticut, USA.
- Department of Radiology, UConn Health, Farmington, Connecticut, USA.
- Department of Computer Science, University of Cincinnati, Cincinnati, Ohio, USA.
Funding
- NCI NIH HHS
- University of Connecticut
Cite
APA
Jeny, A. A., Hamzehei, S., Jin, A., Baker, S. A., Van Rathe, T., Bai, J., Yang, C., & Nabavi, S. (2025). Hybrid transformer‐based model for mammogram classification by integrating prior and current images. Medical Physics, 52(5), 2999-3014. https://doi.org/10.1002/mp.17650
Vancouver
Jeny AA, Hamzehei S, Jin A, Baker SA, Van Rathe T, Bai J, et al. Hybrid transformer‐based model for mammogram classification by integrating prior and current images. Medical Physics. 2025;52(5):2999-3014. doi:10.1002/mp.17650
BibTeX
@article{Jeny2025,
author = {Jeny, Afsana Ahsan and Hamzehei, Sahand and Jin, Annie and Baker, Stephen Andrew and Van Rathe, Tucker and Bai, Jun and Yang, Clifford and Nabavi, Sheida},
title = {Hybrid transformer‐based model for mammogram classification by integrating prior and current images},
journal = {Medical Physics},
year = {2025},
volume = {52},
number = {5},
pages = {2999--3014},
doi = {10.1002/mp.17650}
}
EUVIMED