Monocular suture needle pose detection using synthetic data augmented convolutional neural network
International Journal of Computer Assisted Radiology and Surgery · 2025
DOI: 10.1007/s11548-025-03467-1 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Computer Assisted Radiology and Surgery, 2025. Verfasst von Yifan Wang und 2 weiteren Autor:innen. Beteiligte Einrichtung: Graduate School of Engineering, The University of Tokyo, 7-chōme-3-1 Hongō, Bunkyo, Tokyo, 113-8656, Japan. wang-yifan971125@g.ecc.u-tokyo.ac.jp. Hauptthemen laut MEDLINE: Neural Networks, Computer, Robotic Surgical Procedures, Needles, Suture Techniques. Die Arbeit nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: The University of Tokyo.
Abstract (Originalsprache)
Purpose
Robotic microsurgery enhances the dexterity and stability of the surgeon to perform precise and delicate surgical procedures at microscopic level. Accurate needle pose estimation is critical for robotic micro-suturing, enabling optimized insertion trajectories and facilitating autonomous control. However, accurately estimating the pose of a needle during manipulation, particularly under monocular vision, remains a challenge. This study proposes a convolutional neural network-based method to estimate the pose of a suture needle from monocular images.
Methods
The 3D pose of the needle is estimated using keypoints information from 2D images. A convolutional neural network was trained to estimate the positions of keypoints on the needle, specifically the tip, middle and end point. A hybrid dataset comprising images from both real-world and synthetic simulated environments was developed to train the model. Subsequently, an algorithm was designed to estimate the 3D positions of these keypoints. The 2D keypoint detection and 3D orientation estimation were evaluated by translation and orientation error metrics, respectively.
Results
Experiments conducted on synthetic data showed that the average translation error of tip point, middle point and end point being 0.107 mm, 0.118 mm and 0.098 mm, and the average orientation angular error was 12.75 $$^{\circ }$$ ∘ for normal vector and 15.55 $$^{\circ }$$ ∘ for direction vector. When evaluated on real data, the method demonstrated 2D translation errors averaging 0.047 mm, 0.052 mm and 0.049 mm for the respective keypoints, with 93.85% of detected keypoints having errors below 4 pixels.
Conclusions
This study presents a CNN-based method, augmented with synthetic images, to estimate the pose of a suture needle in monocular vision. Experimental results indicate that the method effectively estimates the 2D positions and 3D orientations of the suture needle in synthetic images. The model also shows reasonable performance with real data, highlighting its promise for real-time application in robotic microsurgery.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Graduate School of Engineering, The University of Tokyo, 7-chōme-3-1 Hongō, Bunkyo, Tokyo, 113-8656, Japan. wang-yifan971125@g.ecc.u-tokyo.ac.jp.
- Graduate School of Medicine, The University of Tokyo, 7-chōme-3-1 Hongō, Bunkyo, Tokyo, 113-0033, Japan.
- Graduate School of Engineering, The University of Tokyo, 7-chōme-3-1 Hongō, Bunkyo, Tokyo, 113-8656, Japan.
Förderung
- The University of Tokyo
Zitieren
APA
Wang, Y., Perez, S. A. H., & Harada, K. (2025). Monocular suture needle pose detection using synthetic data augmented convolutional neural network. International Journal of Computer Assisted Radiology and Surgery. https://doi.org/10.1007/s11548-025-03467-1
Vancouver
Wang Y, Perez SAH, Harada K. Monocular suture needle pose detection using synthetic data augmented convolutional neural network. International Journal of Computer Assisted Radiology and Surgery. 2025. doi:10.1007/s11548-025-03467-1
BibTeX
@article{Wang2025,
author = {Wang, Yifan and Perez, Saul Alexis Heredia and Harada, Kanako},
title = {Monocular suture needle pose detection using synthetic data augmented convolutional neural network},
journal = {International Journal of Computer Assisted Radiology and Surgery},
year = {2025},
doi = {10.1007/s11548-025-03467-1}
}
EUVIMED