EUVIMEDEUVIMED entdecken
Crossref

A Cross-Scale Hierarchical Transformer With Correspondence-Augmented Attention for Inferring Bird’s-Eye-View Semantic Segmentation

Naiyu Fang, Lemiao Qiu, Shuyou Zhang, Zili Wang, Kerui Hu, Kang Wang

IEEE Transactions on Intelligent Transportation Systems · 2024-07 · 25 (7) · 7726-7737

DOI: 10.1109/tits.2023.3348795 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Intelligent Transportation Systems, 2024-07. Verfasst von Naiyu Fang und 5 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 54 Literaturangaben. Gefördert von: Natural Science Foundation of Zhejiang Province, National Natural Science Foundation of China, Pioneer and Leading Goose Research and Development Program of Zhejiang.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

As bird’s-eye-view (BEV) semantic segmentation is simple-to-visualize and easy-to-handle, it has been applied in autonomous driving to provide the surrounding information to downstream tasks. Inferring BEV semantic segmentation conditioned on multi-camera-view images is a popular scheme in the community as cheap devices and real-time processing. The recent work implemented this task by learning the content and position relationship via Vision Transformer (ViT). However, its quadratic complexity confines the relationship learning only in the latent layer, leaving the scale gap to impede the representation of fine-grained objects. In view of information absorption, when representing position-related BEV features, their weighted fusion of all view feature imposes inconducive features to disturb the fusion of conducive features. To tackle these issues, we propose a novel cross-scale hierarchical Transformer with correspondence-augmented attention for semantic segmentation inference. Specifically, we devise a hierarchical framework to refine the BEV feature representation, where the last size is only half of the final segmentation. To save the computation increase caused by this hierarchical framework, we exploit the cross-scale Transformer to learn feature relationships in a reversed-aligning way, and leverage the residual connection of BEV features to facilitate information transmission between scales. We propose correspondence-augmented attention to distinguish conducive and inconducive correspondences. It is implemented in a simple yet effective way, amplifying attention scores before the Softmax operation, so that the position-view-related and the position-view-disrelated attention scores are highlighted and suppressed. Extensive experiments demonstrate that our method has state-of-the-art performance in inferring BEV semantic segmentation conditioned on multi-camera-view images.

Förderung

  • Natural Science Foundation of Zhejiang Province
  • National Natural Science Foundation of China
  • Pioneer and Leading Goose Research and Development Program of Zhejiang

Zitieren

APA

Fang, N., Qiu, L., Zhang, S., Wang, Z., Hu, K., & Wang, K. (2024). A Cross-Scale Hierarchical Transformer With Correspondence-Augmented Attention for Inferring Bird’s-Eye-View Semantic Segmentation. IEEE Transactions on Intelligent Transportation Systems, 25(7), 7726-7737. https://doi.org/10.1109/tits.2023.3348795

Vancouver

Fang N, Qiu L, Zhang S, Wang Z, Hu K, Wang K. A Cross-Scale Hierarchical Transformer With Correspondence-Augmented Attention for Inferring Bird’s-Eye-View Semantic Segmentation. IEEE Transactions on Intelligent Transportation Systems. 2024;25(7):7726-7737. doi:10.1109/tits.2023.3348795

BibTeX
@article{Fang2024,
  author = {Fang, Naiyu and Qiu, Lemiao and Zhang, Shuyou and Wang, Zili and Hu, Kerui and Wang, Kang},
  title = {A Cross-Scale Hierarchical Transformer With Correspondence-Augmented Attention for Inferring Bird’s-Eye-View Semantic Segmentation},
  journal = {IEEE Transactions on Intelligent Transportation Systems},
  year = {2024},
  volume = {25},
  number = {7},
  pages = {7726--7737},
  doi = {10.1109/tits.2023.3348795}
}
Kostenlos starten →