EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Automatic Multiview Alignment of RGB-D Range Maps of Upper Limb Anatomy

Luca Di Angelo iD, Paolo Di Stefano iD, Emanuele Guardiani iD, Paolo Neri iD, Alessandro Paoli iD, Armando Viviano Razionale iD

Sensors · 2023

DOI: 10.3390/s23187841 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, 2023. Verfasst von Luca Di Angelo und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Industrial and Information Engineering and Economics, University of L'Aquila, 67100 L'Aquila, Italy. Hauptthemen laut MEDLINE: Upper Extremity, Forearm. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 59 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Digital representations of anatomical parts are crucial for various biomedical applications. This paper presents an automatic alignment procedure for creating accurate 3D models of upper limb anatomy using a low-cost handheld 3D scanner. The goal is to overcome the challenges associated with forearm 3D scanning, such as needing multiple views, stability requirements, and optical undercuts. While bulky and expensive multi-camera systems have been used in previous research, this study explores the feasibility of using multiple consumer RGB-D sensors for scanning human anatomies. The proposed scanner comprises three Intel® RealSenseTM D415 depth cameras assembled on a lightweight circular jig, enabling simultaneous acquisition from three viewpoints. To achieve automatic alignment, the paper introduces a procedure that extracts common key points between acquisitions deriving from different scanner poses. Relevant hand key points are detected using a neural network, which works on the RGB images captured by the depth cameras. A set of forearm key points is meanwhile identified by processing the acquired data through a specifically developed algorithm that seeks the forearm’s skeleton line. The alignment process involves automatic, rough 3D alignment and fine registration using an iterative-closest-point (ICP) algorithm expressly developed for this application. The proposed method was tested on forearm scans and compared the results obtained by a manual coarse alignment followed by an ICP algorithm for fine registration using commercial software. Deviations below 5 mm, with a mean value of 1.5 mm, were found. The obtained results are critically discussed and compared with the available implementations of published methods. The results demonstrate significant improvements to the state of the art and the potential of the proposed approach to accelerate the acquisition process and automatically register point clouds from different scanner poses without the intervention of skilled operators. This study contributes to developing effective upper limb rehabilitation frameworks and personalized biomedical applications by addressing these critical challenges.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Upper ExtremityForearmHumansHandAlgorithmsNeural Networks, Computer

Stichwörter der Autor:innen

3D optical scanningautomatic point cloud alignmentdepth camerasneural networkupper limb anatomy

Autor:innen und Institutionen

  • Department of Industrial and Information Engineering and Economics, University of L'Aquila, 67100 L'Aquila, Italy.
  • Department of Civil and Industrial Engineering, University of Pisa, 56122 Pisa, Italy.

ORCID-Profile: Luca Di Angelo, Paolo Di Stefano, Emanuele Guardiani, Paolo Neri, Alessandro Paoli, Armando Viviano Razionale

Zitieren

APA

Di Angelo, L., Di Stefano, P., Guardiani, E., Neri, P., Paoli, A., & Razionale, A. V. (2023). Automatic Multiview Alignment of RGB-D Range Maps of Upper Limb Anatomy. Sensors. https://doi.org/10.3390/s23187841

Vancouver

Di Angelo L, Di Stefano P, Guardiani E, Neri P, Paoli A, Razionale AV. Automatic Multiview Alignment of RGB-D Range Maps of Upper Limb Anatomy. Sensors. 2023. doi:10.3390/s23187841

BibTeX
@article{DiAngelo2023,
  author = {Di Angelo, Luca and Di Stefano, Paolo and Guardiani, Emanuele and Neri, Paolo and Paoli, Alessandro and Razionale, Armando Viviano},
  title = {Automatic Multiview Alignment of RGB-D Range Maps of Upper Limb Anatomy},
  journal = {Sensors},
  year = {2023},
  doi = {10.3390/s23187841}
}
Kostenlos starten →