EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

CatStep: Automated Cataract Surgical Phase Classification and Boundary Segmentation Leveraging Inflated 3D-Convolutional Neural Network Architectures and BigCat

Ossama Mahmoud, Han Zhang, Nicholas Matton, Shahzad I Mian, Bradford Tannen, Nambi Nallasamy

Ophthalmology Science · 2024-01 · 4 (1) · 100405

DOI: 10.1016/j.xops.2023.100405 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Ophthalmology Science, 2024-01. Verfasst von Ossama Mahmoud und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Ophthalmology and Visual Sciences, Kellogg Eye Center, University of Michigan, Ann Arbor, Michigan. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 18 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: NEI NIH HHS, National Institutes of Health, NEI.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Objective

Accurate identification of surgical phases during cataract surgery is essential for improving surgical feedback and performance analysis. Time spent in each surgical phase is an indicator of performance, and segmenting out specific phases for further analysis can simplify providing both qualitative and quantitative feedback on surgical maneuvers. Study Design: Retrospective surgical video analysis. Subjects: One hundred ninety cataract surgical videos from the BigCat dataset (comprising nearly 4 million frames, each labeled with 1 of 11 nonoverlapping surgical phases).

Methods

Four machine learning architectures were developed for segmentation of surgical phases. Models were trained using cataract surgical videos from the BigCat dataset. Main Outcome Measures: Models were evaluated using metrics applied to frame-by-frame output and, uniquely in this work, metrics applied to phase output.

Results

The final model, CatStep, a combination of a temporally sensitive model (Inflated 3D Densenet) and a spatially sensitive model (Densenet169), achieved an F1-score of 0.91 and area under the receiver operating characteristic curve of 0.95. Phase-level metrics showed considerable boundary segmentation performance with a median absolute error of phase start and end time of just 0.3 seconds and 0.1 seconds, respectively, a segmental F1-score @70 of 0.94, an oversegmentation score of 0.89, and a segmental edit score of 0.92.

Conclusion

This study demonstrates the feasibility of high-performance automated surgical phase identification for cataract surgery and highlights the potential for improved surgical feedback and performance analysis. Financial Disclosures: Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.

Schlagwörter

Stichwörter der Autor:innen

AICataract surgeryMachine learningResident trainingSurgical feedback

Autor:innen und Institutionen

  • Department of Ophthalmology and Visual Sciences, Kellogg Eye Center, University of Michigan, Ann Arbor, Michigan.
  • School of Medicine, Wayne State University, Detroit, Michigan.
  • Department of Biostatistics, School of Public Health, University of Michigan, Ann Arbor, Michigan.
  • Department of Computer Science, University of Michigan, Ann Arbor, Michigan.
  • Department of Computational Medicine and Bioinformatics, University of Michigan, Ann Arbor, Michigan.

Förderung

  • NEI NIH HHS
  • National Institutes of Health
  • NEI
  • Doctors Company Foundation

Zitieren

APA

Mahmoud, O., Zhang, H., Matton, N., Mian, S. I., Tannen, B., & Nallasamy, N. (2024). CatStep: Automated Cataract Surgical Phase Classification and Boundary Segmentation Leveraging Inflated 3D-Convolutional Neural Network Architectures and BigCat. Ophthalmology Science, 4(1), 100405. https://doi.org/10.1016/j.xops.2023.100405

Vancouver

Mahmoud O, Zhang H, Matton N, Mian SI, Tannen B, Nallasamy N. CatStep: Automated Cataract Surgical Phase Classification and Boundary Segmentation Leveraging Inflated 3D-Convolutional Neural Network Architectures and BigCat. Ophthalmology Science. 2024;4(1):100405. doi:10.1016/j.xops.2023.100405

BibTeX
@article{Mahmoud2024,
  author = {Mahmoud, Ossama and Zhang, Han and Matton, Nicholas and Mian, Shahzad I and Tannen, Bradford and Nallasamy, Nambi},
  title = {CatStep: Automated Cataract Surgical Phase Classification and Boundary Segmentation Leveraging Inflated 3D-Convolutional Neural Network Architectures and BigCat},
  journal = {Ophthalmology Science},
  year = {2024},
  volume = {4},
  number = {1},
  pages = {100405},
  doi = {10.1016/j.xops.2023.100405}
}
Kostenlos starten →