Towards Real-World Aerial Vision Guidance With Categorical 6D Pose Tracker
IEEE Transactions on Pattern Analysis and Machine Intelligence · 2025-07 · 47 (7) · 6055-6072
DOI: 10.1109/tpami.2025.3558237 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2025-07. Verfasst von Jingtao Sun und 2 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 72 Literaturangaben. Gefördert von: National Natural Science Foundation of China, National Natural Science Foundation of Hunan Province, Hunan Xiangjiang Laboratory Funds.
Abstract (Originalsprache)
Tracking the object 6-DoF pose is crucial for various downstream robot tasks and real-world applications. In this paper, we investigate the real-world robot task of aerial vision guidance for aerial robotics manipulation, utilizing category-level 6-DoF pose tracking. Aerial conditions inevitably introduce special challenges, such as rapid viewpoint changes in pitch and roll and inter-frame differences. To support these challenges in task, we first introduce a robust category-level 6-DoF pose tracker (Robust6DoF). This tracker leverages shape and temporal prior knowledge to explore optimal inter-frame keypoint pairs, generated under a priori structural adaptive supervision in a coarse-to-fine manner. Notably, our Robust6DoF employs a Spatial-Temporal Augmentation module to deal with the problems of the inter-frame differences and intra-class shape variations through both temporal dynamic filtering and shape-similarity filtering. We further present a Pose-Aware Discrete Servo strategy (PAD-Servo), serving as a decoupling approach to implement the final aerial vision guidance task. It contains two servo action policies to better accommodate the structural properties of aerial robotics manipulation. Exhaustive experiments on four well-known public benchmarks demonstrate the superiority of our Robust6DoF. Real-world tests directly verify that our Robust6DoF along with PAD-Servo can be readily used in real-world aerial robotic applications. The project homepage is released at Robust6DoF.
Förderung
- National Natural Science Foundation of China
- National Natural Science Foundation of Hunan Province
- Hunan Xiangjiang Laboratory Funds
Zitieren
APA
Sun, J., Wang, Y., & Wang, D. (2025). Towards Real-World Aerial Vision Guidance With Categorical 6D Pose Tracker. IEEE Transactions on Pattern Analysis and Machine Intelligence, 47(7), 6055-6072. https://doi.org/10.1109/tpami.2025.3558237
Vancouver
Sun J, Wang Y, Wang D. Towards Real-World Aerial Vision Guidance With Categorical 6D Pose Tracker. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2025;47(7):6055-6072. doi:10.1109/tpami.2025.3558237
BibTeX
@article{Sun2025,
author = {Sun, Jingtao and Wang, Yaonan and Wang, Danwei},
title = {Towards Real-World Aerial Vision Guidance With Categorical 6D Pose Tracker},
journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
year = {2025},
volume = {47},
number = {7},
pages = {6055--6072},
doi = {10.1109/tpami.2025.3558237}
}
EUVIMED