EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

PhacoTrainer: Deep Learning for Cataract Surgical Videos to Track Surgical Tools

Hsu-Hang Yeh, Anjal M Jain, Olivia Fox, Kostya Sebov, Sophia Y Wang

Translational Vision Science & Technology · 22.03.2023 · 12 (3) · 23

DOI: 10.1167/tvst.12.3.23 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Translational Vision Science & Technology, erschienen am 22.03.2023. Verfasst von Hsu-Hang Yeh und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Biomedical Data Science, Stanford University, Palo Alto, CA, USA. Hauptthemen laut MEDLINE: Deep Learning, Cataract, Cataract Extraction. Die Arbeit wurde bisher 24-mal zitiert (Crossref) und nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: NEI NIH HHS.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Purpose

The purpose of this study was to build a deep-learning model that automatically analyzes cataract surgical videos for the locations of surgical landmarks, and to derive skill-related motion metrics.

Methods

The locations of the pupil, limbus, and 8 classes of surgical instruments were identified by a 2-step algorithm: (1) mask segmentation and (2) landmark identification from the masks. To perform mask segmentation, we trained the YOLACT model on 1156 frames sampled from 268 videos and the public Cataract Dataset for Image Segmentation (CaDIS) dataset. Landmark identification was performed by fitting ellipses or lines to the contours of the masks and deriving locations of interest, including surgical tooltips and the pupil center. Landmark identification was evaluated by the distance between the predicted and true positions in 5853 frames of 10 phacoemulsification video clips. We derived the total path length, maximal speed, and covered area using the tip positions and examined the correlation with human-rated surgical performance.

Results

The mean average precision score and intersection-over-union for mask detection were 0.78 and 0.82. The average distance between the predicted and true positions of the pupil center, phaco tip, and second instrument tip was 5.8, 9.1, and 17.1 pixels. The total path length and covered areas of these landmarks were negatively correlated with surgical performance.

Conclusions

We developed a deep-learning method to localize key anatomical portions of the eye and cataract surgical tools, which can be used to automatically derive metrics correlated with surgical skill. Translational Relevance: Our system could form the basis of an automated feedback system that helps cataract surgeons evaluate their performance.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Deep LearningCataractCataract ExtractionHumansPupilAlgorithms

Autor:innen und Institutionen

  • Department of Biomedical Data Science, Stanford University, Palo Alto, CA, USA.
  • Department of Ophthalmology, Byers Eye Institute, Stanford University, Palo Alto, CA, USA.
  • Krieger School of Arts and Sciences, Johns Hopkins University, Baltimore, MD, USA.

Förderung

  • NEI NIH HHS

Zitieren

APA

Yeh, H. H., Jain, A. M., Fox, O., Sebov, K., & Wang, S. Y. (2023). PhacoTrainer: Deep Learning for Cataract Surgical Videos to Track Surgical Tools. Translational Vision Science & Technology, 12(3), 23. https://doi.org/10.1167/tvst.12.3.23

Vancouver

Yeh HH, Jain AM, Fox O, Sebov K, Wang SY. PhacoTrainer: Deep Learning for Cataract Surgical Videos to Track Surgical Tools. Translational Vision Science & Technology. 2023;12(3):23. doi:10.1167/tvst.12.3.23

BibTeX
@article{Yeh2023,
  author = {Yeh, Hsu-Hang and Jain, Anjal M and Fox, Olivia and Sebov, Kostya and Wang, Sophia Y},
  title = {PhacoTrainer: Deep Learning for Cataract Surgical Videos to Track Surgical Tools},
  journal = {Translational Vision Science & Technology},
  year = {2023},
  volume = {12},
  number = {3},
  pages = {23},
  doi = {10.1167/tvst.12.3.23}
}
Kostenlos starten →