Deep learning-based virtual staining, segmentation, and classification in label-free photoacoustic histology of human specimens
Light: Science & Applications · 02.09.2024 · 13 (1)
DOI: 10.1038/s41377-024-01554-7 ↗Kurz gefasst
Fachartikel in der Zeitschrift Light: Science & Applications, online erschienen am 02.09.2024. Verfasst von Chiho Yoon und 7 weiteren Autor:innen. Beteiligte Einrichtung: Departments of Electrical Engineering, Convergence IT Engineering, Mechanical Engineering, Medical Science and Engineering, Graduate School of Artifi…. Die Arbeit wurde bisher 112-mal zitiert (Crossref) und nennt 95 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Research Foundation of Korea (NRF).
Abstract (Originalsprache)
In pathological diagnostics, histological images highlight the oncological features of excised specimens, but they require laborious and costly staining procedures. Despite recent innovations in label-free microscopy that simplify complex staining procedures, technical limitations and inadequate histological visualization are still problems in clinical settings. Here, we demonstrate an interconnected deep learning (DL)-based framework for performing automated virtual staining, segmentation, and classification in label-free photoacoustic histology (PAH) of human specimens. The framework comprises three components: (1) an explainable contrastive unpaired translation (E-CUT) method for virtual H&E (VHE) staining, (2) an U-net architecture for feature segmentation, and (3) a DL-based stepwise feature fusion method (StepFF) for classification. The framework demonstrates promising performance at each step of its application to human liver cancers. In virtual staining, the E-CUT preserves the morphological aspects of the cell nucleus and cytoplasm, making VHE images highly similar to real H&E ones. In segmentation, various features (e.g., the cell area, number of cells, and the distance between cell nuclei) have been successfully segmented in VHE images. Finally, by using deep feature vectors from PAH, VHE, and segmented images, StepFF has achieved a 98.00% classification accuracy, compared to the 94.80% accuracy of conventional PAH classification. In particular, StepFF’s classification reached a sensitivity of 100% based on the evaluation of three pathologists, demonstrating its applicability in real clinical settings. This series of DL methods for label-free PAH has great potential as a practical clinical strategy for digital pathology.
Autor:innen und Institutionen
- Departments of Electrical Engineering, Convergence IT Engineering, Mechanical Engineering, Medical Science and Engineering, Graduate School of Artificial Intelligence, and Medical Device Innovation Center, Pohang Univer…
- Opticho Inc., Pohang, Republic of Korea.
- Department of Health Sciences and Technology, Gachon Advanced Institute for Health Sciences and Technology (GAIHST), Gachon University, Incheon, Republic of Korea.
- Cancer Research Institute, College of Medicine, The Catholic University of Korea, Seoul, Republic of Korea. ckjung@catholic.ac.kr.
- Department of Hospital Pathology, Seoul St. Mary's Hospital, College of Medicine, The Catholic University of Korea, Seoul, Republic of Korea. ckjung@catholic.ac.kr.
- Opticho Inc., Pohang, Republic of Korea. chulhong@postech.edu.
Förderung
- National Research Foundation of Korea (NRF)
Zitieren
APA
Yoon, C., Park, E., Misra, S., Kim, J. Y., Baik, J. W., Kim, K. G., Jung, C. K., & Kim, C. (2024). Deep learning-based virtual staining, segmentation, and classification in label-free photoacoustic histology of human specimens. Light: Science & Applications, 13(1). https://doi.org/10.1038/s41377-024-01554-7
Vancouver
Yoon C, Park E, Misra S, Kim JY, Baik JW, Kim KG, et al. Deep learning-based virtual staining, segmentation, and classification in label-free photoacoustic histology of human specimens. Light: Science & Applications. 2024;13(1). doi:10.1038/s41377-024-01554-7
BibTeX
@article{Yoon2024,
author = {Yoon, Chiho and Park, Eunwoo and Misra, Sampa and Kim, Jin Young and Baik, Jin Woo and Kim, Kwang Gi and Jung, Chan Kwon and Kim, Chulhong},
title = {Deep learning-based virtual staining, segmentation, and classification in label-free photoacoustic histology of human specimens},
journal = {Light: Science & Applications},
year = {2024},
volume = {13},
number = {1},
doi = {10.1038/s41377-024-01554-7}
}
EUVIMED