The Impact of Cervical Cytology Category Imbalance on Self-Supervised Representation Learning
Computational and Structural Biotechnology Journal · 01.03.2026 · 35 (1)
DOI: 10.34133/csbj.0048 ↗Kurz gefasst
Fachartikel in der Zeitschrift Computational and Structural Biotechnology Journal, online erschienen am 24.04.2026. Verfasst von Shijie Liu und 7 weiteren Autor:innen. Beteiligte Einrichtung: MoE Key Laboratory for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan 4300…. Die Arbeit nennt 36 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: National Natural Science Foundation of China, China Postdoctoral Science Foundation, Southern Medical University Research Start-up Foundation.
Abstract (Originalsprache)
The method of pre-training on extensive unlabeled data, followed by transferring the learned representations to downstream tasks with limited labeled data, has been effective in various fields. However, this paradigm faces the challenge of extreme data imbalance in cervical cytology, with positive cells in whole-slide images constituting approximately 1%. In this paper, we propose a pipeline for investigating the impact of this extreme category imbalance on self-supervised representation learning (SSRL). The pipeline consists of 2 stages: SSRL and downstream tasks. In the SSRL stage, we employ 2 well-established methods, masked autoencoders and the simple framework for contrastive learning, across 9 datasets with varying degrees of imbalance. The pre-trained representations are then transferred to downstream tasks by employing both linear probing and fine-tuning techniques. Additionally, we examine the effect of SSRL on annotation efficiency by varying the quantities of annotation (annotation budget). Our investigation leverages a total of 168,000 image tiles derived from 1,320 whole-slide images obtained from multiple centers. Our findings indicate a noticeable decline in accuracy (Acc) within downstream tasks as data balance shifts from 1:1 to 1:100, with a maximum drop of about 4%. This highlights the substantial impact of data imbalance on SSRL, particularly evident in downstream tasks with lower annotation rates, such as at a 1% budget. Furthermore, the downstream tasks demonstrate the potential to achieve accuracy comparable to those of scenarios with a high annotation budget (50%), even when utilizing a limited annotation budget (5%). The code is available at https://github.com/LGBluesky/ICISSRL .
Autor:innen und Institutionen
- MoE Key Laboratory for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan 430074, Hubei, China.
- Department of Clinical Laboratory, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan 430030, Hubei, China.
- School of Biomedical Engineering and Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou 510515, Guangdong, China.
ORCID-Profile: Shijie Liu, Xuben Chang, Xiuli Liucor, Shenghua Cheng
Förderung
- National Natural Science Foundation of China
- China Postdoctoral Science Foundation
- Southern Medical University Research Start-up Foundation
Zitieren
APA
Liu, S., Chang, X., Bai, J., Chen, L., Zeng, S., Quan, T., Liucor, X., & Cheng, S. (2026). The Impact of Cervical Cytology Category Imbalance on Self-Supervised Representation Learning. Computational and Structural Biotechnology Journal, 35(1). https://doi.org/10.34133/csbj.0048
Vancouver
Liu S, Chang X, Bai J, Chen L, Zeng S, Quan T, et al. The Impact of Cervical Cytology Category Imbalance on Self-Supervised Representation Learning. Computational and Structural Biotechnology Journal. 2026;35(1). doi:10.34133/csbj.0048
BibTeX
@article{Liu2026,
author = {Liu, Shijie and Chang, Xuben and Bai, Jiaxin and Chen, Li and Zeng, Shaoqun and Quan, Tingwei and Liucor, Xiuli and Cheng, Shenghua},
title = {The Impact of Cervical Cytology Category Imbalance on Self-Supervised Representation Learning},
journal = {Computational and Structural Biotechnology Journal},
year = {2026},
volume = {35},
number = {1},
doi = {10.34133/csbj.0048}
}
EUVIMED