Fault-tolerant cross-modal pose realignment for heterogeneous air–ground localization
Tsinghua Science and Technology · 20.11.2026
DOI: 10.26599/tst.2026.9010106 ↗Kurz gefasst
Fachartikel in der Zeitschrift Tsinghua Science and Technology, online erschienen am 20.11.2026. Verfasst von Zhuozhu Jian und 8 weiteren Autor:innen.
Abstract (Originalsprache)
Air–ground localization becomes brittle when visual–inertial drift or an abrupt state jump places a camera pose outside the attraction basin of local camera–LiDAR registration. We address this recovery problem with a coarse-to-fine cross-modal pose-realignment framework. Visual features are back-projected and evaluated against local LiDAR planes through point-to-plane residuals, avoiding learned appearance correspondences at run time. An association-quality check determines whether the propagated pose is sufficiently supported by local geometry. When the support is insufficient, a bounded particle swarm optimization (PSO) search selects a coarse pose hypothesis, which is subsequently re-fined by a visual–inertial–LiDAR factor graph. The proposed framework therefore couples implicit geometric association, bounded basin exploration, and local multimodal refinement to recover from large pose errors. Experiments use the Eu-RoC sequences with a static Leica scan and real indoor and outdoor air–ground platforms with UGV-provided maps. In the reported severe cases, the method reduces translational RMSE by 33.8% under a 0.5 m initial offset and reduces post-disturbance mean absolute position error by 55.2% after a 30◦ mid-sequence yaw jump, relative to the best successful baseline in each test. Indoor tests with one UGV and three UAVs further demonstrate 20 Hz operation in a shared LiDAR map frame.
Zitieren
APA
Jian, Z., Li, Q., Yi, A., Zheng, S., Sun, L., Zhang, B., Zhou, Z., Wang, X., & Chen, X. (2026). Fault-tolerant cross-modal pose realignment for heterogeneous air–ground localization. Tsinghua Science and Technology. https://doi.org/10.26599/tst.2026.9010106
Vancouver
Jian Z, Li Q, Yi A, Zheng S, Sun L, Zhang B, et al. Fault-tolerant cross-modal pose realignment for heterogeneous air–ground localization. Tsinghua Science and Technology. 2026. doi:10.26599/tst.2026.9010106
BibTeX
@article{Jian2026,
author = {Jian, Zhuozhu and Li, Qixuan and Yi, An and Zheng, Shengtao and Sun, Lizhi and Zhang, Bin and Zhou, Ziyi and Wang, Xueqian and Chen, Xinlei},
title = {Fault-tolerant cross-modal pose realignment for heterogeneous air–ground localization},
journal = {Tsinghua Science and Technology},
year = {2026},
doi = {10.26599/tst.2026.9010106}
}
EUVIMED