EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Acquiring Aligned Endoscopic and Depth Image Pairs Using Structured‐Light Projection, Neural Surfaces and an Electromagnetic Positional Sensor

Ryo Furukawa iD, Taiyo Inui, Ryusuke Sagawa, Hiroshi Kawasaki

Healthcare Technology Letters · 2025-01 · 12 (1)

DOI: 10.1049/htl2.70039 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Healthcare Technology Letters, online erschienen am 08.12.2025. Verfasst von Ryo Furukawa und 3 weiteren Autor:innen. Beteiligte Einrichtung: Kindai University Higashihiroshima Hiroshima Japan. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 41 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: New Energy and Industrial Technology Development Organization.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Minimally invasive endoscopic procedures are gaining importance for better patient outcomes. While traditional systems use standard cameras, there is an increasing demand for 3D information to improve diagnostic and surgical accuracy. As a result, various 3D endoscopic systems have been developed, with structured‐light (SL) projection gaining traction for its compatibility with existing equipment. Despite advances in SL based scan, practical 3D endoscopy still faces key challenges. These include issues like pattern interference and pose estimation failures. Additionally, removing projected patterns to obtain clean texture images remain crucial for medical diagnosis. To address these challenges, we propose an approach based on neural signed distance field (neural SDF), incorporating a pattern reflection model. The method integrates (1) camera pose estimation using an electromagnetic sensors, (2) 3D shape measurement via SL projection, (3) multi‐frame shape integration using a neural implicit surface representation, and (4) removal of projected patterns from endoscopic images using a pix2pix model. To ensure robust optimization, electromagnetic tracking provides accurate initial camera poses for optimization. By simulating SL projection in the neural surface model and optimizing camera pose, projector pose, and surface geometry, and by removing SL projection from the captured images, we can obtain paired sequences of endoscopic and depth maps.

Schlagwörter

Stichwörter der Autor:innen

data acquisitionendoscopesimage reconstruction

Autor:innen und Institutionen

  • Kindai University Higashihiroshima Hiroshima Japan.
  • Denso IT Laboratory, Inc. Minato-ku Tokyo Japan.
  • Faculty of Information Science and Electrical Engineering Department of Advanced Information Technology Kyushu University Nishi-ku Fukuoka Japan.

ORCID-Profile: Ryo Furukawa

Förderung

  • New Energy and Industrial Technology Development Organization

Zitieren

APA

Furukawa, R., Inui, T., Sagawa, R., & Kawasaki, H. (2025). Acquiring Aligned Endoscopic and Depth Image Pairs Using Structured‐Light Projection, Neural Surfaces and an Electromagnetic Positional Sensor. Healthcare Technology Letters, 12(1). https://doi.org/10.1049/htl2.70039

Vancouver

Furukawa R, Inui T, Sagawa R, Kawasaki H. Acquiring Aligned Endoscopic and Depth Image Pairs Using Structured‐Light Projection, Neural Surfaces and an Electromagnetic Positional Sensor. Healthcare Technology Letters. 2025;12(1). doi:10.1049/htl2.70039

BibTeX
@article{Furukawa2025,
  author = {Furukawa, Ryo and Inui, Taiyo and Sagawa, Ryusuke and Kawasaki, Hiroshi},
  title = {Acquiring Aligned Endoscopic and Depth Image Pairs Using Structured‐Light Projection, Neural Surfaces and an Electromagnetic Positional Sensor},
  journal = {Healthcare Technology Letters},
  year = {2025},
  volume = {12},
  number = {1},
  doi = {10.1049/htl2.70039}
}
Kostenlos starten →