EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Using spatial-temporal ensembles of convolutional neural networks for lumen segmentation in ureteroscopy

Jorge F Lazo, Aldo Marzullo, Sara Moccia, Michele Catellani, Benoit Rosa, Michel de Mathelin, Elena De Momi

International Journal of Computer Assisted Radiology and Surgery · 2021-06 · 16 (6) · 915-922

DOI: 10.1007/s11548-021-02376-3 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Computer Assisted Radiology and Surgery, online erschienen am 28.04.2021. Verfasst von Jorge F Lazo und 6 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electronics, Information and Bioengineering, Politecnico di Milano, Milan, Italy. jorgefrancisco.lazo@polimi.it. Hauptthemen laut MEDLINE: Neural Networks, Computer. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 20 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Horizon 2020.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Purpose

Ureteroscopy is an efficient endoscopic minimally invasive technique for the diagnosis and treatment of upper tract urothelial carcinoma. During ureteroscopy, the automatic segmentation of the hollow lumen is of primary importance, since it indicates the path that the endoscope should follow. In order to obtain an accurate segmentation of the hollow lumen, this paper presents an automatic method based on convolutional neural networks (CNNs).

Methods

The proposed method is based on an ensemble of 4 parallel CNNs to simultaneously process single and multi-frame information. Of these, two architectures are taken as core-models, namely U-Net based in residual blocks ( $$m_1$$ m 1 ) and Mask-RCNN ( $$m_2$$ m 2 ), which are fed with single still-frames I ( t ). The other two models ( $$M_1$$ M 1 , $$M_2$$ M 2 ) are modifications of the former ones consisting on the addition of a stage which makes use of 3D convolutions to process temporal information. $$M_1$$ M 1 , $$M_2$$ M 2 are fed with triplets of frames ( $$I(t-1)$$ I ( t - 1 ) , I ( t ), $$I(t+1)$$ I ( t + 1 ) ) to produce the segmentation for I ( t ).

Results

The proposed method was evaluated using a custom dataset of 11 videos (2673 frames) which were collected and manually annotated from 6 patients. We obtain a Dice similarity coefficient of 0.80, outperforming previous state-of-the-art methods.

Conclusion

The obtained results show that spatial-temporal information can be effectively exploited by the ensemble model to improve hollow lumen segmentation in ureteroscopic images. The method is effective also in the presence of poor visibility, occasional bleeding, or specular reflections.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Neural Networks, ComputerHumansImage Processing, Computer-AssistedUreteroscopy

Stichwörter der Autor:innen

Convolutional neural networksDeep learningImage segmentationUpper tract urothelial carcinoma (UTUC)Ureteroscopy

Autor:innen und Institutionen

  • Department of Electronics, Information and Bioengineering, Politecnico di Milano, Milan, Italy. jorgefrancisco.lazo@polimi.it.
  • ICube, UMR 7357, CNRS-Université de Strasbourg, Strasbourg, France. jorgefrancisco.lazo@polimi.it.
  • Department of Mathematics and Computer Science, University of Calabria, Rende, CS, Italy.
  • The BioRobotics Institute, Scuola Superiore Sant'Anna, Pisa, Italy.
  • Department of Excellence in Robotics and AI, Scuola Superiore Sant'Anna, Pisa, Italy.
  • Istituto Europeo di Oncologia, Milan, Italy.

Förderung

  • Horizon 2020

Zitieren

APA

Lazo, J. F., Marzullo, A., Moccia, S., Catellani, M., Rosa, B., de Mathelin, M., & De Momi, E. (2021). Using spatial-temporal ensembles of convolutional neural networks for lumen segmentation in ureteroscopy. International Journal of Computer Assisted Radiology and Surgery, 16(6), 915-922. https://doi.org/10.1007/s11548-021-02376-3

Vancouver

Lazo JF, Marzullo A, Moccia S, Catellani M, Rosa B, de Mathelin M, et al. Using spatial-temporal ensembles of convolutional neural networks for lumen segmentation in ureteroscopy. International Journal of Computer Assisted Radiology and Surgery. 2021;16(6):915-922. doi:10.1007/s11548-021-02376-3

BibTeX
@article{Lazo2021,
  author = {Lazo, Jorge F and Marzullo, Aldo and Moccia, Sara and Catellani, Michele and Rosa, Benoit and de Mathelin, Michel and De Momi, Elena},
  title = {Using spatial-temporal ensembles of convolutional neural networks for lumen segmentation in ureteroscopy},
  journal = {International Journal of Computer Assisted Radiology and Surgery},
  year = {2021},
  volume = {16},
  number = {6},
  pages = {915--922},
  doi = {10.1007/s11548-021-02376-3}
}
Kostenlos starten →