EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Monocular suture needle pose detection using synthetic data augmented convolutional neural network

Yifan Wang, Saul Alexis Heredia Perez, Kanako Harada

International Journal of Computer Assisted Radiology and Surgery · 2025

DOI: 10.1007/s11548-025-03467-1 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Computer Assisted Radiology and Surgery, 2025. Verfasst von Yifan Wang und 2 weiteren Autor:innen. Beteiligte Einrichtung: Graduate School of Engineering, The University of Tokyo, 7-chōme-3-1 Hongō, Bunkyo, Tokyo, 113-8656, Japan. wang-yifan971125@g.ecc.u-tokyo.ac.jp. Hauptthemen laut MEDLINE: Neural Networks, Computer, Robotic Surgical Procedures, Needles, Suture Techniques. Die Arbeit nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: The University of Tokyo.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Purpose

Robotic microsurgery enhances the dexterity and stability of the surgeon to perform precise and delicate surgical procedures at microscopic level. Accurate needle pose estimation is critical for robotic micro-suturing, enabling optimized insertion trajectories and facilitating autonomous control. However, accurately estimating the pose of a needle during manipulation, particularly under monocular vision, remains a challenge. This study proposes a convolutional neural network-based method to estimate the pose of a suture needle from monocular images.

Methods

The 3D pose of the needle is estimated using keypoints information from 2D images. A convolutional neural network was trained to estimate the positions of keypoints on the needle, specifically the tip, middle and end point. A hybrid dataset comprising images from both real-world and synthetic simulated environments was developed to train the model. Subsequently, an algorithm was designed to estimate the 3D positions of these keypoints. The 2D keypoint detection and 3D orientation estimation were evaluated by translation and orientation error metrics, respectively.

Results

Experiments conducted on synthetic data showed that the average translation error of tip point, middle point and end point being 0.107 mm, 0.118 mm and 0.098 mm, and the average orientation angular error was 12.75 $$^{\circ }$$ ∘ for normal vector and 15.55 $$^{\circ }$$ ∘ for direction vector. When evaluated on real data, the method demonstrated 2D translation errors averaging 0.047 mm, 0.052 mm and 0.049 mm for the respective keypoints, with 93.85% of detected keypoints having errors below 4 pixels.

Conclusions

This study presents a CNN-based method, augmented with synthetic images, to estimate the pose of a suture needle in monocular vision. Experimental results indicate that the method effectively estimates the 2D positions and 3D orientations of the suture needle in synthetic images. The model also shows reasonable performance with real data, highlighting its promise for real-time application in robotic microsurgery.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Neural Networks, ComputerRobotic Surgical ProceduresNeedlesSuture TechniquesMicrosurgeryImaging, Three-DimensionalHumansAlgorithmsConvolutional Neural Networks

Stichwörter der Autor:innen

Needle pose estimationNeural networkRobotic-assisted microsurgerySimulator

Autor:innen und Institutionen

  • Graduate School of Engineering, The University of Tokyo, 7-chōme-3-1 Hongō, Bunkyo, Tokyo, 113-8656, Japan. wang-yifan971125@g.ecc.u-tokyo.ac.jp.
  • Graduate School of Medicine, The University of Tokyo, 7-chōme-3-1 Hongō, Bunkyo, Tokyo, 113-0033, Japan.
  • Graduate School of Engineering, The University of Tokyo, 7-chōme-3-1 Hongō, Bunkyo, Tokyo, 113-8656, Japan.

Förderung

  • The University of Tokyo

Zitieren

APA

Wang, Y., Perez, S. A. H., & Harada, K. (2025). Monocular suture needle pose detection using synthetic data augmented convolutional neural network. International Journal of Computer Assisted Radiology and Surgery. https://doi.org/10.1007/s11548-025-03467-1

Vancouver

Wang Y, Perez SAH, Harada K. Monocular suture needle pose detection using synthetic data augmented convolutional neural network. International Journal of Computer Assisted Radiology and Surgery. 2025. doi:10.1007/s11548-025-03467-1

BibTeX
@article{Wang2025,
  author = {Wang, Yifan and Perez, Saul Alexis Heredia and Harada, Kanako},
  title = {Monocular suture needle pose detection using synthetic data augmented convolutional neural network},
  journal = {International Journal of Computer Assisted Radiology and Surgery},
  year = {2025},
  doi = {10.1007/s11548-025-03467-1}
}
Kostenlos starten →