EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

An Appearance-Semantic Descriptor with Coarse-to-Fine Matching for Robust VPR

Jie Chen, Wenbo Li, Pengshuai Hou iD, Zipeng Yang, Haoyu Zhao

Sensors · 29.03.2024 · 24 (7) · 2203

DOI: 10.3390/s24072203 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 29.03.2024. Verfasst von Jie Chen und 4 weiteren Autor:innen. Beteiligte Einrichtung: School of Mechanical Engineering and Automation, Northeastern University, Shenyang 110819, China. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 32 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Fundamental Research Funds for Central Universities.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In recent years, semantic segmentation has made significant progress in visual place recognition (VPR) by using semantic information that is relatively invariant to appearance and viewpoint, demonstrating great potential. However, in some extreme scenarios, there may be semantic occlusion and semantic sparsity, which can lead to confusion when relying solely on semantic information for localization. Therefore, this paper proposes a novel VPR framework that employs a coarse-to-fine image matching strategy, combining semantic and appearance information to improve algorithm performance. First, we construct SemLook global descriptors using semantic contours, which can preliminarily screen images to enhance the accuracy and real-time performance of the algorithm. Based on this, we introduce SemLook local descriptors for fine screening, combining robust appearance information extracted by deep learning with semantic information. These local descriptors can address issues such as semantic overlap and sparsity in urban environments, further improving the accuracy of the algorithm. Through this refined screening process, we can effectively handle the challenges of complex image matching in urban environments and obtain more accurate results. The performance of SemLook descriptors is evaluated on three public datasets (Extended-CMU Season, Robot-Car Seasons v2, and SYNTHIA) and compared with six state-of-the-art VPR algorithms (HOG, CoHOG, AlexNet_VPR, Region VLAD, Patch-NetVLAD, Forest). In the experimental comparison, considering both real-time performance and evaluation metrics, the SemLook descriptors are found to outperform the other six algorithms. Evaluation metrics include the area under the curve (AUC) based on the precision–recall curve, Recall@100%Precision, and Precision@100%Recall. On the Extended-CMU Season dataset, SemLook descriptors achieve a 100% AUC value, and on the SYNTHIA dataset, they achieve a 99% AUC value, demonstrating outstanding performance. The experimental results indicate that introducing global descriptors for initial screening and utilizing local descriptors combining both semantic and appearance information for precise matching can effectively address the issue of location recognition in scenarios with semantic ambiguity or sparsity. This algorithm enhances descriptor performance, making it more accurate and robust in scenes with variations in appearance and viewpoint.

Schlagwörter

Stichwörter der Autor:innen

appearance-semantic information fusioncoarse-to-fine matching strategysemantic segmentationvisual place recognition

Autor:innen und Institutionen

  • School of Mechanical Engineering and Automation, Northeastern University, Shenyang 110819, China.

ORCID-Profile: Pengshuai Hou

Förderung

  • National Natural Science Foundation of China
  • Fundamental Research Funds for Central Universities

Zitieren

APA

Chen, J., Li, W., Hou, P., Yang, Z., & Zhao, H. (2024). An Appearance-Semantic Descriptor with Coarse-to-Fine Matching for Robust VPR. Sensors, 24(7), 2203. https://doi.org/10.3390/s24072203

Vancouver

Chen J, Li W, Hou P, Yang Z, Zhao H. An Appearance-Semantic Descriptor with Coarse-to-Fine Matching for Robust VPR. Sensors. 2024;24(7):2203. doi:10.3390/s24072203

BibTeX
@article{Chen2024,
  author = {Chen, Jie and Li, Wenbo and Hou, Pengshuai and Yang, Zipeng and Zhao, Haoyu},
  title = {An Appearance-Semantic Descriptor with Coarse-to-Fine Matching for Robust VPR},
  journal = {Sensors},
  year = {2024},
  volume = {24},
  number = {7},
  pages = {2203},
  doi = {10.3390/s24072203}
}
Kostenlos starten →