2D/3D deformable registration for endoscopic camera images using self-supervised offline learning of intraoperative pneumothorax deformation
Computerized Medical Imaging and Graphics · 2024
DOI: 10.1016/j.compmedimag.2024.102418 ↗Kurz gefasst
Fachartikel in der Zeitschrift Computerized Medical Imaging and Graphics, 2024. Verfasst von Tomoki Oya und 3 weiteren Autor:innen. Beteiligte Einrichtung: Graduate School of Informatics, Kyoto University, Yoshida-Honmachi, Sakyo, Kyoto, 606-8501, Japan. Hauptthemen laut MEDLINE: Pneumothorax, Imaging, Three-Dimensional. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 46 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Japan Society for the Promotion of Science.
Abstract (Originalsprache)
Shape registration of patient-specific organ shapes to endoscopic camera images is expected to be a key to realizing image-guided surgery, and a variety of applications of machine learning methods have been considered. Because the number of training data available from clinical cases is limited, the use of synthetic images generated from a statistical deformation model has been attempted; however, the influence on estimation caused by the difference between synthetic images and real scenes is a problem. In this study, we propose a self-supervised offline learning framework for model-based registration using image features commonly obtained from synthetic images and real camera images. Because of the limited number of endoscopic images available for training, we use a synthetic image generated from the nonlinear deformation model that represents possible intraoperative pneumothorax deformations. In order to solve the difficulty in estimating deformed shapes and viewpoints from the common image features obtained from synthetic and real images, we attempted to improve the registration error by adding the shading and distance information that can be obtained as prior knowledge in the synthetic image. Shape registration with real camera images is performed by learning the task of predicting the differential model parameters between two synthetic images. The developed framework achieved registration accuracy with a mean absolute error of less than 10 mm and a mean distance of less than 5 mm in a thoracoscopic pulmonary cancer resection, confirming improved prediction accuracy compared with conventional methods.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Graduate School of Informatics, Kyoto University, Yoshida-Honmachi, Sakyo, Kyoto, 606-8501, Japan.
- Nagoya University Hospital, 65 Tsurumai-cho, Showa-ku, Nagoya, 466-8550, Japan.
- Graduate School of Medicine, Kyoto University, 53 Shogoin Kawahara-cho, Sakyo, Kyoto, 606-8507, Japan. Electronic address: nakao.megumi.6x@kyoto-u.ac.jp.
Förderung
- Japan Society for the Promotion of Science
Zitieren
APA
Oya, T., Kadomatsu, Y., Chen-Yoshikawa, T. F., & Nakao, M. (2024). 2D/3D deformable registration for endoscopic camera images using self-supervised offline learning of intraoperative pneumothorax deformation. Computerized Medical Imaging and Graphics. https://doi.org/10.1016/j.compmedimag.2024.102418
Vancouver
Oya T, Kadomatsu Y, Chen-Yoshikawa TF, Nakao M. 2D/3D deformable registration for endoscopic camera images using self-supervised offline learning of intraoperative pneumothorax deformation. Computerized Medical Imaging and Graphics. 2024. doi:10.1016/j.compmedimag.2024.102418
BibTeX
@article{Oya2024,
author = {Oya, Tomoki and Kadomatsu, Yuka and Chen-Yoshikawa, Toyofumi Fengshi and Nakao, Megumi},
title = {2D/3D deformable registration for endoscopic camera images using self-supervised offline learning of intraoperative pneumothorax deformation},
journal = {Computerized Medical Imaging and Graphics},
year = {2024},
doi = {10.1016/j.compmedimag.2024.102418}
}
EUVIMED