A Unified Visual Information Preservation Framework for Self-supervised Pre-training in Medical Image Analysis
IEEE Transactions on Pattern Analysis and Machine Intelligence · 2023
DOI: 10.1109/tpami.2023.3234002 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023. Verfasst von Hong-Yu Zhou und 4 weiteren Autor:innen. Hauptthemen laut MEDLINE: Algorithms, Brain Neoplasms. Die Arbeit wurde bisher 71-mal zitiert (Crossref) und nennt 49 Literaturangaben.
Abstract (Originalsprache)
Recent advances in self-supervised learning (SSL) in computer vision are primarily comparative, whose goal is to preserve invariant and discriminative semantics in latent representations by comparing siamese image views. However, the preserved high-level semantics do not contain enough local information, which is vital in medical image analysis (e.g., image-based diagnosis and tumor segmentation). To mitigate the locality problem of comparative SSL, we propose to incorporate the task of pixel restoration for explicitly encoding more pixel-level information into high-level semantics. We also address the preservation of scale information, a powerful tool in aiding image understanding but has not drawn much attention in SSL. The resulting framework can be formulated as a multi-task optimization problem on the feature pyramid. Specifically, we conduct multi-scale pixel restoration and siamese feature comparison in the pyramid. In addition, we propose non-skip U-Net to build the feature pyramid and develop sub-crop to replace multi-crop in 3D medical imaging. The proposed unified SSL framework (PCRLv2) surpasses its self-supervised counterparts on various tasks, including brain tumor segmentation (BraTS 2018), chest pathology identification (ChestX-ray, CheXpert), pulmonary nodule detection (LUNA), and abdominal organ segmentation (LiTS), sometimes outperforming them by large margins with limited annotations. Codes and models are available at https://github.com/RL4M/PCRLv2.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Zitieren
APA
Zhou, H. Y., Lu, C., Chen, C., Yang, S., & Yu, Y. (2023). A Unified Visual Information Preservation Framework for Self-supervised Pre-training in Medical Image Analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence. https://doi.org/10.1109/tpami.2023.3234002
Vancouver
Zhou HY, Lu C, Chen C, Yang S, Yu Y. A Unified Visual Information Preservation Framework for Self-supervised Pre-training in Medical Image Analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2023. doi:10.1109/tpami.2023.3234002
BibTeX
@article{Zhou2023,
author = {Zhou, Hong-Yu and Lu, Chixiang and Chen, Chaoqi and Yang, Sibei and Yu, Yizhou},
title = {A Unified Visual Information Preservation Framework for Self-supervised Pre-training in Medical Image Analysis},
journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
year = {2023},
doi = {10.1109/tpami.2023.3234002}
}
EUVIMED