EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Seamless augmented reality integration in arthroscopy: a pipeline for articular reconstruction and guidance

Hongchao Shu iD, Mingxu Liu, Lalithkumar Seenivasan, Suxi Gu, Ping-Cheng Ku, Jonathan Knopf, Russell Taylor, Mathias Unberath

Healthcare Technology Letters · 2025-01 · 12 (1)

DOI: 10.1049/htl2.12119 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Healthcare Technology Letters, online erschienen am 10.01.2025. Verfasst von Hongchao Shu und 7 weiteren Autor:innen. Beteiligte Einrichtung: Department of Computer Science Johns Hopkins University Baltimore Maryland USA. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 46 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Arthrex.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Arthroscopy is a minimally invasive surgical procedure used to diagnose and treat joint problems. The clinical workflow of arthroscopy typically involves inserting an arthroscope into the joint through a small incision, during which surgeons navigate and operate largely by relying on their visual assessment through the arthroscope. However, the arthroscope's restricted field of view and lack of depth perception pose challenges in navigating complex articular structures and achieving surgical precision during procedures. Aiming at enhancing intraoperative awareness, a robust pipeline that incorporates simultaneous localization and mapping, depth estimation, and 3D Gaussian splatting (3D GS) is presented to realistically reconstruct intra‐articular structures solely based on monocular arthroscope video. Extending 3D reconstruction to augmented reality (AR) applications, the solution offers AR assistance for articular notch measurement and annotation anchoring in a human‐in‐the‐loop manner. Compared to traditional structure‐from‐motion and neural radiance field‐based methods, the pipeline achieves dense 3D reconstruction and competitive rendering fidelity with explicit 3D representation in 7 min on average. When evaluated on four phantom datasets, our method achieves root‐mean‐square‐error reconstruction error, peak signal‐to‐noise ratio and structure similarity index measure on average. Because the pipeline enables AR reconstruction and guidance directly from monocular arthroscopy without any additional data and/or hardware, the solution may hold the potential for enhancing intraoperative awareness and facilitating surgical precision in arthroscopy. The AR measurement tool achieves accuracy within and the AR annotation tool achieves a mIoU of 0.721.

Schlagwörter

Stichwörter der Autor:innen

augmented realitycomputer visionendoscopesimage reconstruction

Autor:innen und Institutionen

  • Department of Computer Science Johns Hopkins University Baltimore Maryland USA.
  • Department of Orthopedics Tsinghua Changgung Hospital Tsinghua University School of Medicine Beijing China.
  • Arthrex Inc. Naples Florida USA.

ORCID-Profile: Hongchao Shu

Förderung

  • Arthrex

Zitieren

APA

Shu, H., Liu, M., Seenivasan, L., Gu, S., Ku, P. C., Knopf, J., Taylor, R., & Unberath, M. (2025). Seamless augmented reality integration in arthroscopy: a pipeline for articular reconstruction and guidance. Healthcare Technology Letters, 12(1). https://doi.org/10.1049/htl2.12119

Vancouver

Shu H, Liu M, Seenivasan L, Gu S, Ku PC, Knopf J, et al. Seamless augmented reality integration in arthroscopy: a pipeline for articular reconstruction and guidance. Healthcare Technology Letters. 2025;12(1). doi:10.1049/htl2.12119

BibTeX
@article{Shu2025,
  author = {Shu, Hongchao and Liu, Mingxu and Seenivasan, Lalithkumar and Gu, Suxi and Ku, Ping-Cheng and Knopf, Jonathan and Taylor, Russell and Unberath, Mathias},
  title = {Seamless augmented reality integration in arthroscopy: a pipeline for articular reconstruction and guidance},
  journal = {Healthcare Technology Letters},
  year = {2025},
  volume = {12},
  number = {1},
  doi = {10.1049/htl2.12119}
}
Infokarte | EUVIMED

Artikeldaten derzeit nicht verfügbar.

Recherche