Acquiring Aligned Endoscopic and Depth Image Pairs Using Structured‐Light Projection, Neural Surfaces and an Electromagnetic Positional Sensor
Healthcare Technology Letters · 2025-01 · 12 (1)
DOI: 10.1049/htl2.70039 ↗Kurz gefasst
Fachartikel in der Zeitschrift Healthcare Technology Letters, online erschienen am 08.12.2025. Verfasst von Ryo Furukawa und 3 weiteren Autor:innen. Beteiligte Einrichtung: Kindai University Higashihiroshima Hiroshima Japan. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 41 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: New Energy and Industrial Technology Development Organization.
Abstract (Originalsprache)
Minimally invasive endoscopic procedures are gaining importance for better patient outcomes. While traditional systems use standard cameras, there is an increasing demand for 3D information to improve diagnostic and surgical accuracy. As a result, various 3D endoscopic systems have been developed, with structured‐light (SL) projection gaining traction for its compatibility with existing equipment. Despite advances in SL based scan, practical 3D endoscopy still faces key challenges. These include issues like pattern interference and pose estimation failures. Additionally, removing projected patterns to obtain clean texture images remain crucial for medical diagnosis. To address these challenges, we propose an approach based on neural signed distance field (neural SDF), incorporating a pattern reflection model. The method integrates (1) camera pose estimation using an electromagnetic sensors, (2) 3D shape measurement via SL projection, (3) multi‐frame shape integration using a neural implicit surface representation, and (4) removal of projected patterns from endoscopic images using a pix2pix model. To ensure robust optimization, electromagnetic tracking provides accurate initial camera poses for optimization. By simulating SL projection in the neural surface model and optimizing camera pose, projector pose, and surface geometry, and by removing SL projection from the captured images, we can obtain paired sequences of endoscopic and depth maps.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Kindai University Higashihiroshima Hiroshima Japan.
- Denso IT Laboratory, Inc. Minato-ku Tokyo Japan.
- Faculty of Information Science and Electrical Engineering Department of Advanced Information Technology Kyushu University Nishi-ku Fukuoka Japan.
ORCID-Profile: Ryo Furukawa
Förderung
- New Energy and Industrial Technology Development Organization
Zitieren
APA
Furukawa, R., Inui, T., Sagawa, R., & Kawasaki, H. (2025). Acquiring Aligned Endoscopic and Depth Image Pairs Using Structured‐Light Projection, Neural Surfaces and an Electromagnetic Positional Sensor. Healthcare Technology Letters, 12(1). https://doi.org/10.1049/htl2.70039
Vancouver
Furukawa R, Inui T, Sagawa R, Kawasaki H. Acquiring Aligned Endoscopic and Depth Image Pairs Using Structured‐Light Projection, Neural Surfaces and an Electromagnetic Positional Sensor. Healthcare Technology Letters. 2025;12(1). doi:10.1049/htl2.70039
BibTeX
@article{Furukawa2025,
author = {Furukawa, Ryo and Inui, Taiyo and Sagawa, Ryusuke and Kawasaki, Hiroshi},
title = {Acquiring Aligned Endoscopic and Depth Image Pairs Using Structured‐Light Projection, Neural Surfaces and an Electromagnetic Positional Sensor},
journal = {Healthcare Technology Letters},
year = {2025},
volume = {12},
number = {1},
doi = {10.1049/htl2.70039}
}
EUVIMED