SpecReFlow: an algorithm for specular reflection restoration using flow-guided video completion
Journal of Medical Imaging · 24.04.2024 · 11 (02) · 1-19
DOI: 10.1117/1.jmi.11.2.024012 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Medical Imaging, erschienen am 24.04.2024. Verfasst von Haoli Yin und 3 weiteren Autor:innen. Beteiligte Einrichtung: Vanderbilt University, Department of Computer Science, Nashville, Tennessee, United States. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NIDDK NIH HHS, National Institute of Diabetes and Digestive and Kidney Diseases.
Abstract (Originalsprache)
PurposeSpecular reflections (SRs) are highlight artifacts commonly found in endoscopy videos that can severely disrupt a surgeon’s observation and judgment. Despite numerous attempts to restore SR, existing methods are inefficient and time consuming and can lead to false clinical interpretations. Therefore, we propose the first complete deep-learning solution, SpecReFlow, to detect and restore SR regions from endoscopy video with spatial and temporal coherence.ApproachSpecReFlow consists of three stages: (1) an image preprocessing stage to enhance contrast, (2) a detection stage to indicate where the SR region is present, and (3) a restoration stage in which we replace SR pixels with an accurate underlying tissue structure. Our restoration approach uses optical flow to seamlessly propagate color and structure from other frames of the endoscopy video.ResultsComprehensive quantitative and qualitative tests for each stage reveal that our SpecReFlow solution performs better than previous detection and restoration methods. Our detection stage achieves a Dice score of 82.8% and a sensitivity of 94.6%, and our restoration stage successfully incorporates temporal information with spatial information for more accurate restorations than existing techniques.ConclusionsSpecReFlow is a first-of-its-kind solution that combines temporal and spatial information for effective detection and restoration of SR regions, surpassing previous methods relying on single-frame spatial information. Future work will look to optimizing SpecReFlow for real-time applications. SpecReFlow is a software-only solution for restoring image content lost due to SR, making it readily deployable in existing clinical settings to improve endoscopy video quality for accurate diagnosis and treatment.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Vanderbilt University, Department of Computer Science, Nashville, Tennessee, United States.
- Vanderbilt University, Vanderbilt Biophotonics Center, Nashville, Tennessee, United States.
- Vanderbilt University, Department of Biomedical Engineering, Nashville, Tennessee, United States.
- Vanderbilt University, Department of Electrical and Computer Engineering, Nashville, Tennessee, United States.
ORCID-Profile: Haoli Yin, Rachel Eimen
Förderung
- NIDDK NIH HHS
- National Institute of Diabetes and Digestive and Kidney Diseases
Zitieren
APA
Yin, H., Eimen, R., Moyer, D., & Bowden, A. K. (2024). SpecReFlow: an algorithm for specular reflection restoration using flow-guided video completion. Journal of Medical Imaging, 11(02), 1-19. https://doi.org/10.1117/1.jmi.11.2.024012
Vancouver
Yin H, Eimen R, Moyer D, Bowden AK. SpecReFlow: an algorithm for specular reflection restoration using flow-guided video completion. Journal of Medical Imaging. 2024;11(02):1-19. doi:10.1117/1.jmi.11.2.024012
BibTeX
@article{Yin2024,
author = {Yin, Haoli and Eimen, Rachel and Moyer, Daniel and Bowden, Audrey K},
title = {SpecReFlow: an algorithm for specular reflection restoration using flow-guided video completion},
journal = {Journal of Medical Imaging},
year = {2024},
volume = {11},
number = {02},
pages = {1--19},
doi = {10.1117/1.jmi.11.2.024012}
}
EUVIMED