EUVIMEDEUVIMED entdecken
Crossref

A Unified Visual Information Preservation Framework for Self-supervised Pre-training in Medical Image Analysis

Hong-Yu Zhou, Chixiang Lu, Chaoqi Chen, Sibei Yang, Yizhou Yu

IEEE Transactions on Pattern Analysis and Machine Intelligence · 2023

DOI: 10.1109/tpami.2023.3234002 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023. Verfasst von Hong-Yu Zhou und 4 weiteren Autor:innen. Hauptthemen laut MEDLINE: Algorithms, Brain Neoplasms. Die Arbeit wurde bisher 71-mal zitiert (Crossref) und nennt 49 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Recent advances in self-supervised learning (SSL) in computer vision are primarily comparative, whose goal is to preserve invariant and discriminative semantics in latent representations by comparing siamese image views. However, the preserved high-level semantics do not contain enough local information, which is vital in medical image analysis (e.g., image-based diagnosis and tumor segmentation). To mitigate the locality problem of comparative SSL, we propose to incorporate the task of pixel restoration for explicitly encoding more pixel-level information into high-level semantics. We also address the preservation of scale information, a powerful tool in aiding image understanding but has not drawn much attention in SSL. The resulting framework can be formulated as a multi-task optimization problem on the feature pyramid. Specifically, we conduct multi-scale pixel restoration and siamese feature comparison in the pyramid. In addition, we propose non-skip U-Net to build the feature pyramid and develop sub-crop to replace multi-crop in 3D medical imaging. The proposed unified SSL framework (PCRLv2) surpasses its self-supervised counterparts on various tasks, including brain tumor segmentation (BraTS 2018), chest pathology identification (ChestX-ray, CheXpert), pulmonary nodule detection (LUNA), and abdominal organ segmentation (LiTS), sometimes outperforming them by large margins with limited annotations. Codes and models are available at https://github.com/RL4M/PCRLv2.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

AlgorithmsBrain NeoplasmsHumansImaging, Three-DimensionalSemanticsImage Processing, Computer-Assisted

Zitieren

APA

Zhou, H. Y., Lu, C., Chen, C., Yang, S., & Yu, Y. (2023). A Unified Visual Information Preservation Framework for Self-supervised Pre-training in Medical Image Analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence. https://doi.org/10.1109/tpami.2023.3234002

Vancouver

Zhou HY, Lu C, Chen C, Yang S, Yu Y. A Unified Visual Information Preservation Framework for Self-supervised Pre-training in Medical Image Analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2023. doi:10.1109/tpami.2023.3234002

BibTeX
@article{Zhou2023,
  author = {Zhou, Hong-Yu and Lu, Chixiang and Chen, Chaoqi and Yang, Sibei and Yu, Yizhou},
  title = {A Unified Visual Information Preservation Framework for Self-supervised Pre-training in Medical Image Analysis},
  journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
  year = {2023},
  doi = {10.1109/tpami.2023.3234002}
}
Kostenlos starten →