EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

SpecReFlow: an algorithm for specular reflection restoration using flow-guided video completion

Haoli Yin iD, Rachel Eimen iD, Daniel Moyer, Audrey K Bowden

Journal of Medical Imaging · 24.04.2024 · 11 (02) · 1-19

DOI: 10.1117/1.jmi.11.2.024012 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Medical Imaging, erschienen am 24.04.2024. Verfasst von Haoli Yin und 3 weiteren Autor:innen. Beteiligte Einrichtung: Vanderbilt University, Department of Computer Science, Nashville, Tennessee, United States. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NIDDK NIH HHS, National Institute of Diabetes and Digestive and Kidney Diseases.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

PurposeSpecular reflections (SRs) are highlight artifacts commonly found in endoscopy videos that can severely disrupt a surgeon’s observation and judgment. Despite numerous attempts to restore SR, existing methods are inefficient and time consuming and can lead to false clinical interpretations. Therefore, we propose the first complete deep-learning solution, SpecReFlow, to detect and restore SR regions from endoscopy video with spatial and temporal coherence.ApproachSpecReFlow consists of three stages: (1) an image preprocessing stage to enhance contrast, (2) a detection stage to indicate where the SR region is present, and (3) a restoration stage in which we replace SR pixels with an accurate underlying tissue structure. Our restoration approach uses optical flow to seamlessly propagate color and structure from other frames of the endoscopy video.ResultsComprehensive quantitative and qualitative tests for each stage reveal that our SpecReFlow solution performs better than previous detection and restoration methods. Our detection stage achieves a Dice score of 82.8% and a sensitivity of 94.6%, and our restoration stage successfully incorporates temporal information with spatial information for more accurate restorations than existing techniques.ConclusionsSpecReFlow is a first-of-its-kind solution that combines temporal and spatial information for effective detection and restoration of SR regions, surpassing previous methods relying on single-frame spatial information. Future work will look to optimizing SpecReFlow for real-time applications. SpecReFlow is a software-only solution for restoring image content lost due to SR, making it readily deployable in existing clinical settings to improve endoscopy video quality for accurate diagnosis and treatment.

Schlagwörter

Stichwörter der Autor:innen

endoscopyimage artifactsimage restorationmultiview restorationoptical flowspecular reflection

Autor:innen und Institutionen

  • Vanderbilt University, Department of Computer Science, Nashville, Tennessee, United States.
  • Vanderbilt University, Vanderbilt Biophotonics Center, Nashville, Tennessee, United States.
  • Vanderbilt University, Department of Biomedical Engineering, Nashville, Tennessee, United States.
  • Vanderbilt University, Department of Electrical and Computer Engineering, Nashville, Tennessee, United States.

ORCID-Profile: Haoli Yin, Rachel Eimen

Förderung

  • NIDDK NIH HHS
  • National Institute of Diabetes and Digestive and Kidney Diseases

Zitieren

APA

Yin, H., Eimen, R., Moyer, D., & Bowden, A. K. (2024). SpecReFlow: an algorithm for specular reflection restoration using flow-guided video completion. Journal of Medical Imaging, 11(02), 1-19. https://doi.org/10.1117/1.jmi.11.2.024012

Vancouver

Yin H, Eimen R, Moyer D, Bowden AK. SpecReFlow: an algorithm for specular reflection restoration using flow-guided video completion. Journal of Medical Imaging. 2024;11(02):1-19. doi:10.1117/1.jmi.11.2.024012

BibTeX
@article{Yin2024,
  author = {Yin, Haoli and Eimen, Rachel and Moyer, Daniel and Bowden, Audrey K},
  title = {SpecReFlow: an algorithm for specular reflection restoration using flow-guided video completion},
  journal = {Journal of Medical Imaging},
  year = {2024},
  volume = {11},
  number = {02},
  pages = {1--19},
  doi = {10.1117/1.jmi.11.2.024012}
}
Kostenlos starten →