EUVIMEDEUVIMED entdecken
Crossref

Nucleus-Aware Self-Supervised Pretraining Using Unpaired Image-to-Image Translation for Histopathology Images

Zhiyun Song, Penghui Du, Junpeng Yan, Kailu Li, Jianzhong Shou, Maode Lai, Yubo Fan, Yan Xu

IEEE Transactions on Medical Imaging · 2024-01 · 43 (1) · 459-472

DOI: 10.1109/tmi.2023.3309971 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Medical Imaging, 2024-01. Verfasst von Zhiyun Song und 7 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 63 Literaturangaben. Gefördert von: National Natural Science Foundation in China, Beijing Natural Science Foundation-Haidian District Joint Fund in China, Beijing Hope Run Special Fund of Cancer Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Self-supervised pretraining attempts to enhance model performance by obtaining effective features from unlabeled data, and has demonstrated its effectiveness in the field of histopathology images. Despite its success, few works concentrate on the extraction of nucleus-level information, which is essential for pathologic analysis. In this work, we propose a novel nucleus-aware self-supervised pretraining framework for histopathology images. The framework aims to capture the nuclear morphology and distribution information through unpaired image-to-image translation between histopathology images and pseudo mask images. The generation process is modulated by both conditional and stochastic style representations, ensuring the reality and diversity of the generated histopathology images for pretraining. Further, an instance segmentation guided strategy is employed to capture instance-level information. The experiments on 7 datasets show that the proposed pretraining method outperforms supervised ones on Kather classification, multiple instance learning, and 5 dense-prediction tasks with the transfer learning protocol, and yields superior results than other self-supervised approaches on 8 semi-supervised tasks. Our project is publicly available at https://github.com/zhiyuns/UNITPathSSL.

Förderung

  • National Natural Science Foundation in China
  • Beijing Natural Science Foundation-Haidian District Joint Fund in China
  • Beijing Hope Run Special Fund of Cancer Foundation of China
  • Fundamental Research Funds for the Central Universities of China from the State Key Laboratory of Software Development Environment, Beihang University, China
  • 111 Project in China
  • High Performance Computing (HPC) Resources with Beihang University

Zitieren

APA

Song, Z., Du, P., Yan, J., Li, K., Shou, J., Lai, M., Fan, Y., & Xu, Y. (2024). Nucleus-Aware Self-Supervised Pretraining Using Unpaired Image-to-Image Translation for Histopathology Images. IEEE Transactions on Medical Imaging, 43(1), 459-472. https://doi.org/10.1109/tmi.2023.3309971

Vancouver

Song Z, Du P, Yan J, Li K, Shou J, Lai M, et al. Nucleus-Aware Self-Supervised Pretraining Using Unpaired Image-to-Image Translation for Histopathology Images. IEEE Transactions on Medical Imaging. 2024;43(1):459-472. doi:10.1109/tmi.2023.3309971

BibTeX
@article{Song2024,
  author = {Song, Zhiyun and Du, Penghui and Yan, Junpeng and Li, Kailu and Shou, Jianzhong and Lai, Maode and Fan, Yubo and Xu, Yan},
  title = {Nucleus-Aware Self-Supervised Pretraining Using Unpaired Image-to-Image Translation for Histopathology Images},
  journal = {IEEE Transactions on Medical Imaging},
  year = {2024},
  volume = {43},
  number = {1},
  pages = {459--472},
  doi = {10.1109/tmi.2023.3309971}
}
Kostenlos starten →