EUVIMEDEUVIMED entdecken
Crossref

Learning 3D Representation From Auto-Labeled 2D Object Boxes

Qian Deng, Le Hui, Jian Yang, Jin Xie

IEEE Transactions on Image Processing · 2026 · 35 · 3566-3580

DOI: 10.1109/tip.2026.3671587 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Image Processing, 2026. Verfasst von Qian Deng und 3 weiteren Autor:innen. Die Arbeit nennt 94 Literaturangaben. Gefördert von: National Key Research and Development Program of China, National Science Fund of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Recent advances in LiDAR representation learning with limited annotations show strong promise. Existing well-performed methods mainly focus on distilling the 2D representation into the 3D representation via superpixels. Superpixels are used to construct the cross-modal contrastive learning, leading to semantic ambiguity of 3D features belonging to the same object and impairing the performance. To this end, we aim to leverage unlabeled LiDAR-camera pairs to design a novel pre-training pipeline, which learns from category space directly and pulls the 3D features belonging to the same object close. Specifically, we obtain autolabeled 2D object boxes with a fixed 2D open-vocabulary object detector and transform the labeled 2D object boxes into high-quality pixel-wise label maps with a box-to-label-maps generation algorithm. Based on the pseudo labels, we present a dual-space pre-training 3D network that recognizes accurate categories from the semantic priors of paired 3D points and segments complete objects. Furthermore, we propose a module named AdaptPro to improve performance further when fine-tuning the 3D network under limited annotations, aiming to explore the unpaired 3D features that lack 2D correspondences via category prototypes. The experimental results show that our method achieves state-of-the-art performances on both the nuScenes and SemanticKITTI benchmark datasets. Code is avialable at https://github.com/dengq7/Box4Scene.

Förderung

  • National Key Research and Development Program of China
  • National Science Fund of China

Zitieren

APA

Deng, Q., Hui, L., Yang, J., & Xie, J. (2026). Learning 3D Representation From Auto-Labeled 2D Object Boxes. IEEE Transactions on Image Processing, 35, 3566-3580. https://doi.org/10.1109/tip.2026.3671587

Vancouver

Deng Q, Hui L, Yang J, Xie J. Learning 3D Representation From Auto-Labeled 2D Object Boxes. IEEE Transactions on Image Processing. 2026;35:3566-3580. doi:10.1109/tip.2026.3671587

BibTeX
@article{Deng2026,
  author = {Deng, Qian and Hui, Le and Yang, Jian and Xie, Jin},
  title = {Learning 3D Representation From Auto-Labeled 2D Object Boxes},
  journal = {IEEE Transactions on Image Processing},
  year = {2026},
  volume = {35},
  pages = {3566--3580},
  doi = {10.1109/tip.2026.3671587}
}
Kostenlos starten →