Revisiting Siamese-Based 3D Single Object Tracking With a Versatile Transformer
IEEE Transactions on Pattern Analysis and Machine Intelligence · 2025-09 · 47 (9) · 8148-8164
DOI: 10.1109/tpami.2025.3581381 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2025-09. Verfasst von Jiaming Liu und 4 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 54 Literaturangaben. Gefördert von: National Natural Science Foundation of China, SJTU Shenlan Program Key Project.
Abstract (Originalsprache)
3D Single Object Tracking (SOT) plays an important role in real-world visual applications such as autonomous driving and planning. How to realize effective 3D SOT is still a valuable challenge due to its carrier-sparse point clouds and its role-complex influencing factors. Inspired by the remote modeling of popular transformers, we further propose a Versatile Point Tracking Transformer (VPTT) method for 3D SOT, with object guidance from the template point cloud to the search area point cloud under the siamese-based tracking paradigm. Specifically, VPTT employs self- and cross- attention mechanisms and extends four matching operations, resulting in leveraging the contextual information of consecutive frames to improve the tracking results. By constructing a deep network VerFormer consisting of four successive transformer layers, which performs matching operations involving fusional transformation, separative discrimination, intersectional interaction, and unidirectional propagation from shallow to deep. Considering that the tracking task involves multiple processes, VPTT further learns how to forecast intermediate outputs including mask probability, trailing distance, and heading angle at each stage. Such a specialized design allows our VPTT to revisit the end-to-end training paradigm used for 3D tracking while developing a versatile transformer that is a perfect fit for the 3D SOT task. Experiments on three benchmarks, KITTI, nuScenes, and Waymo, show that VPTT achieves state-of-the-art tracking performance on siamese-based tracking running at $\sim$∼62 FPS.
Förderung
- National Natural Science Foundation of China
- SJTU Shenlan Program Key Project
Zitieren
APA
Liu, J., Wu, Y., Miao, Q., Gong, M., & Kong, L. (2025). Revisiting Siamese-Based 3D Single Object Tracking With a Versatile Transformer. IEEE Transactions on Pattern Analysis and Machine Intelligence, 47(9), 8148-8164. https://doi.org/10.1109/tpami.2025.3581381
Vancouver
Liu J, Wu Y, Miao Q, Gong M, Kong L. Revisiting Siamese-Based 3D Single Object Tracking With a Versatile Transformer. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2025;47(9):8148-8164. doi:10.1109/tpami.2025.3581381
BibTeX
@article{Liu2025,
author = {Liu, Jiaming and Wu, Yue and Miao, Qiguang and Gong, Maoguo and Kong, Linghe},
title = {Revisiting Siamese-Based 3D Single Object Tracking With a Versatile Transformer},
journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
year = {2025},
volume = {47},
number = {9},
pages = {8148--8164},
doi = {10.1109/tpami.2025.3581381}
}
EUVIMED