Head pose-assisted localization of facial landmarks for enhanced fast registration in skull base surgery
Computerized Medical Imaging and Graphics · 2025
DOI: 10.1016/j.compmedimag.2024.102483 ↗Kurz gefasst
Fachartikel in der Zeitschrift Computerized Medical Imaging and Graphics, 2025. Verfasst von Yifei Yang und 8 weiteren Autor:innen. Beteiligte Einrichtung: School of Optics and Photonics, Beijing Institute of Technology, Beijing, 100081, Beijing, PR China. Hauptthemen laut MEDLINE: Skull Base, Imaging, Three-Dimensional, Face, Anatomic Landmarks. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 39 Literaturangaben. Gefördert von: National Natural Science Foundation of China, China Postdoctoral Science Foundation, Guangzhou Municipal Science and Technology Project.
Abstract (Originalsprache)
In skull base surgery, the method of using a probe to draw or 3D scanners to acquire intraoperative facial point clouds for spatial registration presents several issues. Manual manipulation results in inefficiency and poor consistency. Traditional registration algorithms based on point clouds are highly dependent on the initial pose. The complexity of registration algorithms can also extend the required time. To address these issues, we used an RGB-D camera to capture real-time facial point clouds during surgery. The initial registration of the 3D model reconstructed from preoperative CT/MR images and the point cloud collected during surgery is accomplished through corresponding facial landmarks. The facial point clouds collected intraoperatively often contain rotations caused by the free-angle camera. Benefit from the close spatial geometric relationship between head pose and facial landmarks coordinates, we propose a facial landmarks localization network assisted by estimating head pose. The shared representation head pose estimation module boosts network performance by enhancing its perception of global facial features. The proposed network facilitates the localization of landmark points in both preoperative and intraoperative point clouds, enabling rapid automatic registration. A free-view human facial landmarks dataset called 3D-FVL was synthesized from clinical CT images for training. The proposed network achieves leading localization accuracy and robustness on two public datasets and the 3D-FVL. In clinical experiments, using the Artec Eva scanner, the trained network achieved a concurrent reduction in average registration time to 0.28 s, with an average registration error of 2.33 mm. The proposed method significantly reduced registration time, while meeting clinical accuracy requirements for surgical navigation. Our research will help to improving the efficiency and quality of skull base surgery.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Optics and Photonics, Beijing Institute of Technology, Beijing, 100081, Beijing, PR China.
- School of Optics and Photonics, Beijing Institute of Technology, Beijing, 100081, Beijing, PR China; Zhengzhou Research Institute, Beijing Institute of Technology, Zhengzhou, 450000, Henan, PR China. Electronic address:…
- School of Medical Technology, Beijing Institute of Technology, Beijing, 100081, Beijing, PR China; Zhengzhou Research Institute, Beijing Institute of Technology, Zhengzhou, 450000, Henan, PR China.
- School of Optics and Photonics, Beijing Institute of Technology, Beijing, 100081, Beijing, PR China; Zhengzhou Research Institute, Beijing Institute of Technology, Zhengzhou, 450000, Henan, PR China.
- School of Computer Science and Technology, Beijing Institute of Technology, Beijing, 100081, Beijing, PR China; Zhengzhou Research Institute, Beijing Institute of Technology, Zhengzhou, 450000, Henan, PR China.
- Department of Nasopharyngeal Carcinoma, Sun Yat-sen University Cancer Center, Guangzhou, 510062, Guangdong, PR China.
Förderung
- National Natural Science Foundation of China
- China Postdoctoral Science Foundation
- Guangzhou Municipal Science and Technology Project
- National Key Research and Development Program of China
Zitieren
APA
Yang, Y., Fan, J., Fu, T., Xiao, D., Ma, D., Song, H., Feng, Z., Liu, Y., & Yang, J. (2025). Head pose-assisted localization of facial landmarks for enhanced fast registration in skull base surgery. Computerized Medical Imaging and Graphics. https://doi.org/10.1016/j.compmedimag.2024.102483
Vancouver
Yang Y, Fan J, Fu T, Xiao D, Ma D, Song H, et al. Head pose-assisted localization of facial landmarks for enhanced fast registration in skull base surgery. Computerized Medical Imaging and Graphics. 2025. doi:10.1016/j.compmedimag.2024.102483
BibTeX
@article{Yang2025,
author = {Yang, Yifei and Fan, Jingfan and Fu, Tianyu and Xiao, Deqiang and Ma, Dongsheng and Song, Hong and Feng, Zhengkai and Liu, Youping and Yang, Jian},
title = {Head pose-assisted localization of facial landmarks for enhanced fast registration in skull base surgery},
journal = {Computerized Medical Imaging and Graphics},
year = {2025},
doi = {10.1016/j.compmedimag.2024.102483}
}
EUVIMED