Toward cell nuclei precision between OCT and H&E images translation using signal-to-noise ratio cycle-consistency
Computer Methods and Programs in Biomedicine · 2023
DOI: 10.1016/j.cmpb.2023.107824 ↗Kurz gefasst
Fachartikel in der Zeitschrift Computer Methods and Programs in Biomedicine, 2023. Verfasst von Chih-Hao Liu und 3 weiteren Autor:innen. Beteiligte Einrichtung: Graduate Institute of Photonics and Optoelectronics, National Taiwan University, No.1, Sec. 4, Roosevelt Road, Taipei, 10617, Taiwan. Electronic addr…. Hauptthemen laut MEDLINE: Algorithms, Image Processing, Computer-Assisted. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 65 Literaturangaben. Gefördert von: National Science and Technology Council.
Abstract (Originalsprache)
Medical image-to-image translation is often difficult and of limited effectiveness due to the differences in image acquisition mechanisms and the diverse structure of biological tissues. This work presents an unpaired image translation model between in-vivo optical coherence tomography (OCT) and ex-vivo Hematoxylin and eosin (H&E) stained images without the need for image stacking, registration, post-processing, and annotation. The model can generate high-quality and highly accurate virtual medical images, and is robust and bidirectional. Our framework introduces random noise to (1) blur redundant features, (2) defend against self-adversarial attacks, (3) stabilize inverse conversion, and (4) mitigate the impact of OCT speckles. We also demonstrate that our model can be pre-trained and then fine-tuned using images from different OCT systems in just a few epochs. Qualitative and quantitative comparisons with traditional image-to-image translation models show the robustness of our proposed signal-to-noise ratio (SNR) cycle-consistency method.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Graduate Institute of Photonics and Optoelectronics, National Taiwan University, No.1, Sec. 4, Roosevelt Road, Taipei, 10617, Taiwan. Electronic address: r10941036@ntu.edu.tw.
- Graduate Institute of Communication Engineering, National Taiwan University, No.1, Sec. 4, Roosevelt Road, Taipei, 10617, Taiwan. Electronic address: r10942078@ntu.edu.tw.
- Graduate Institute of Communication Engineering, National Taiwan University, No.1, Sec. 4, Roosevelt Road, Taipei, 10617, Taiwan; Department of Electrical Engineering, National Taiwan University, No.1, Sec. 4, Roosevelt…
- Graduate Institute of Photonics and Optoelectronics, National Taiwan University, No.1, Sec. 4, Roosevelt Road, Taipei, 10617, Taiwan; Department of Electrical Engineering, National Taiwan University, No.1, Sec. 4, Roose…
Förderung
- National Science and Technology Council
Zitieren
APA
Liu, C. H., Fu, L. W., Chen, H. H., & Huang, S. L. (2023). Toward cell nuclei precision between OCT and H&E images translation using signal-to-noise ratio cycle-consistency. Computer Methods and Programs in Biomedicine. https://doi.org/10.1016/j.cmpb.2023.107824
Vancouver
Liu CH, Fu LW, Chen HH, Huang SL. Toward cell nuclei precision between OCT and H&E images translation using signal-to-noise ratio cycle-consistency. Computer Methods and Programs in Biomedicine. 2023. doi:10.1016/j.cmpb.2023.107824
BibTeX
@article{Liu2023,
author = {Liu, Chih-Hao and Fu, Li-Wei and Chen, Homer H and Huang, Sheng-Lung},
title = {Toward cell nuclei precision between OCT and H&E images translation using signal-to-noise ratio cycle-consistency},
journal = {Computer Methods and Programs in Biomedicine},
year = {2023},
doi = {10.1016/j.cmpb.2023.107824}
}
EUVIMED