Overview of Deep Learning-based Visual Localization Methods
ACM Transactions on Multimedia Computing, Communications, and Applications · 2026-11-16
DOI: 10.1145/3857800 ↗At a glance
Journal article in ACM Transactions on Multimedia Computing, Communications, and Applications, published online on 2026-11-16. Written by Jintao Zheng and 5 co-authors. 93 references.
Abstract (original language)
Visual localization seeks to estimate the six degrees of freedom (6-DoF) camera pose from a single input image, and has found extensive applications in augmented reality, mobile robotics, and autonomous driving. This paper provides an overview of the current landscape of visual localization. We present a comprehensive review of mainstream deep learning-based visual localization approaches. Organized around the central theme of data association, this review systematically examines three primary technical paradigms: (1) Absolute Pose Regression (APR), which employs a CNN to directly regress the camera pose from an image; (2) Scene Coordinate Regression (SCR), which predicts per-pixel 3D scene coordinates and subsequently estimates the pose using geometric solvers; and (3) Neural Rendering-based Localization, which refines poses through differentiable rendering and optimization, leveraging implicit neural representations or explicit geometric primitives. The review provides a thorough analysis of representative methods within each category. Finally, we discuss current challenges, including the limited geometric reasoning capability of APR, the scalability issues of SCR in large-scale environments, and the computational bottlenecks associated with neural rendering. This review aims to guide the advancement of robust, efficient, and scalable visual localization systems.
Cite
APA
Zheng, J., Zhang, J., Niu, Z., Tan, Z., Li, M., & Hu, D. (2026). Overview of Deep Learning-based Visual Localization Methods. ACM Transactions on Multimedia Computing, Communications, and Applications. https://doi.org/10.1145/3857800
Vancouver
Zheng J, Zhang J, Niu Z, Tan Z, Li M, Hu D. Overview of Deep Learning-based Visual Localization Methods. ACM Transactions on Multimedia Computing, Communications, and Applications. 2026. doi:10.1145/3857800
BibTeX
@article{Zheng2026,
author = {Zheng, Jintao and Zhang, Jinpu and Niu, Zhongyan and Tan, Zhen and Li, Ming and Hu, Dewen},
title = {Overview of Deep Learning-based Visual Localization Methods},
journal = {ACM Transactions on Multimedia Computing, Communications, and Applications},
year = {2026},
doi = {10.1145/3857800}
}
EUVIMED