Joint Optimization of the 3D Model and 6D Pose for Monocular Pose Estimation
Drones · 30.10.2024 · 8 (11) · 626
DOI: 10.3390/drones8110626 ↗Kurz gefasst
Fachartikel in der Zeitschrift Drones, online erschienen am 30.10.2024. Verfasst von Liangchao Guo und 4 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 52 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Hunan Science and Technology Innovation Program.
Abstract (Originalsprache)
The autonomous landing of unmanned aerial vehicles (UAVs) relies on a precise relative 6D pose between platforms. Existing model-based monocular pose estimation methods need an accurate 3D model of the target. They cannot handle the absence of an accurate 3D model. This paper adopts the multi-view geometry constraints within the monocular image sequence to solve the problem. And a novel approach to monocular pose estimation is introduced, which jointly optimizes the target’s 3D model and the relative 6D pose. We propose to represent the target’s 3D model using a set of sparse 3D landmarks. The 2D landmarks are detected in the input image by a trained neural network. Based on the 2D–3D correspondences, the initial pose estimation is obtained by solving the PnP problem. To achieve joint optimization, this paper builds the objective function based on the minimization of the reprojection error. And the correction values of the 3D landmarks and the 6D pose are parameters to be solved in the optimization problem. By solving the optimization problem, the joint optimization of the target’s 3D model and the 6D pose is realized. In addition, a sliding window combined with a keyframe extraction strategy is adopted to speed up the algorithm processing. Experimental results on synthetic and real image sequences show that the proposed method achieves real-time and online high-precision monocular pose estimation with the absence of an accurate 3D model via the joint optimization of the target’s 3D model and pose.
Förderung
- National Natural Science Foundation of China
- Hunan Science and Technology Innovation Program
Zitieren
APA
Guo, L., Chen, L., Wang, Q., Zhang, Z., & Sun, X. (2024). Joint Optimization of the 3D Model and 6D Pose for Monocular Pose Estimation. Drones, 8(11), 626. https://doi.org/10.3390/drones8110626
Vancouver
Guo L, Chen L, Wang Q, Zhang Z, Sun X. Joint Optimization of the 3D Model and 6D Pose for Monocular Pose Estimation. Drones. 2024;8(11):626. doi:10.3390/drones8110626
BibTeX
@article{Guo2024,
author = {Guo, Liangchao and Chen, Lin and Wang, Qiufu and Zhang, Zhuo and Sun, Xiaoliang},
title = {Joint Optimization of the 3D Model and 6D Pose for Monocular Pose Estimation},
journal = {Drones},
year = {2024},
volume = {8},
number = {11},
pages = {626},
doi = {10.3390/drones8110626}
}
EUVIMED