EUVIMEDEUVIMED entdecken
Crossref

Positional encoding-guided transformer-based multiple instance learning for histopathology whole slide images classification

Jun Shi, Dongdong Sun, Kun Wu, Zhiguo Jiang, Xue Kong, Wei Wang, Haibo Wu, Yushan Zheng

Computer Methods and Programs in Biomedicine · 2025-01 · 258 · 108491

DOI: 10.1016/j.cmpb.2024.108491 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Computer Methods and Programs in Biomedicine, 2025-01. Verfasst von Jun Shi und 7 weiteren Autor:innen. Beteiligte Einrichtung: School of Software, Hefei University of Technology, Hefei, 230601, Anhui Province, China. Hauptthemen laut MEDLINE: Algorithms. Die Arbeit wurde bisher 26-mal zitiert (Crossref) und nennt 48 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

BACKGROUND AND OBJECTIVES: Whole slide image (WSI) classification is of great clinical significance in computer-aided pathological diagnosis. Due to the high cost of manual annotation, weakly supervised WSI classification methods have gained more attention. As the most representative, multiple instance learning (MIL) generally aggregates the predictions or features of the patches within a WSI to achieve the slide-level classification under the weak supervision of WSI labels. However, most existing MIL methods ignore spatial position relationships of the patches, which is likely to strengthen the discriminative ability of WSI-level features. METHODS: In this paper, we propose a novel positional encoding-guided transformer-based multiple instance learning (PEGTB-MIL) method for histopathology WSI classification. It aims to encode the spatial positional property of the patch into its corresponding semantic features and explore the potential correlation among the patches for improving the WSI classification performance. Concretely, the deep features of the patches in WSI are first extracted and simultaneously a position encoder is used to encode the spatial 2D positional information of the patches into the spatial-aware features. After incorporating the semantic features and spatial embeddings, multi-head self-attention (MHSA) is applied to explore the contextual and spatial dependencies of the fused features. Particularly, we introduce an auxiliary reconstruction task to enhance the spatial-semantic consistency and generalization ability of features. RESULTS: The proposed method is evaluated on two public benchmark TCGA datasets (TCGA-LUNG and TCGA-BRCA) and two in-house clinical datasets (USTC-EGFR and USTC-GIST). Experimental results validate it is effective in the tasks of cancer subtyping and gene mutation status prediction. In the test stage, the proposed PEGTB-MIL outperforms the other state-of-the-art methods and respectively achieves 97.13±0.34%, 86.74±2.64%, 83.25±1.65%, and 72.52±1.63% of the area under the receiver operating characteristic (ROC) curve (AUC). CONCLUSION: PEGTB-MIL utilizes positional encoding to effectively guide and reinforce MIL, leading to enhanced performance on downstream WSI classification tasks. Specifically, the introduced auxiliary reconstruction module adeptly preserves the spatial-semantic consistency of patch features. More significantly, this study investigates the relationship between position information and disease diagnosis and presents a promising avenue for further research.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

AlgorithmsHumansLung NeoplasmsImage Processing, Computer-AssistedImage Interpretation, Computer-AssistedDiagnosis, Computer-AssistedMachine Learning

Stichwörter der Autor:innen

Cancer subtypingDigital pathologyGene mutation predictionMultiple instance learningPosition encodingWhole slide image

Autor:innen und Institutionen

  • School of Software, Hefei University of Technology, Hefei, 230601, Anhui Province, China.
  • School of Computer Science and Information Engineering, Hefei University of Technology, Hefei, 230601, Anhui Province, China.
  • Image Processing Center, School of Astronautics, Beihang University, Beijing, 102206, China.
  • Department of Pathology, the First Affiliated Hospital of USTC, Division of Life Sciences and Medicine, University of Science and Technology of China, Hefei, 230036, Anhui Province, China; Intelligent Pathology Institut…
  • School of Engineering Medicine, Beijing Advanced Innovation Center for Biomedical Engineering, Beihang University, Beijing, 100191, China. Electronic address: yszheng@buaa.edu.cn.

Zitieren

APA

Shi, J., Sun, D., Wu, K., Jiang, Z., Kong, X., Wang, W., Wu, H., & Zheng, Y. (2025). Positional encoding-guided transformer-based multiple instance learning for histopathology whole slide images classification. Computer Methods and Programs in Biomedicine, 258, 108491. https://doi.org/10.1016/j.cmpb.2024.108491

Vancouver

Shi J, Sun D, Wu K, Jiang Z, Kong X, Wang W, et al. Positional encoding-guided transformer-based multiple instance learning for histopathology whole slide images classification. Computer Methods and Programs in Biomedicine. 2025;258:108491. doi:10.1016/j.cmpb.2024.108491

BibTeX
@article{Shi2025,
  author = {Shi, Jun and Sun, Dongdong and Wu, Kun and Jiang, Zhiguo and Kong, Xue and Wang, Wei and Wu, Haibo and Zheng, Yushan},
  title = {Positional encoding-guided transformer-based multiple instance learning for histopathology whole slide images classification},
  journal = {Computer Methods and Programs in Biomedicine},
  year = {2025},
  volume = {258},
  pages = {108491},
  doi = {10.1016/j.cmpb.2024.108491}
}
Kostenlos starten →