Waterway-BEV: Generate Bird’s Eye View Layouts of a Waterway From a First-Person View Camera Using Cross-View Transformers
IEEE Transactions on Intelligent Transportation Systems · 2025-06 · 26 (6) · 8078-8096
DOI: 10.1109/tits.2025.3554717 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Intelligent Transportation Systems, 2025-06. Verfasst von Feng Ma und 5 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 39 Literaturangaben. Gefördert von: National Key Research and Development Program of China, National Natural Science Foundation of China, Research on the Implementation Plan of the New Generation Shipping System in Pingdingshan, Luohe, and Zhoukou.
Abstract (Originalsprache)
In the domain of autonomous ship navigation, the construction of bird’s-eye view (BEV) layouts for waterways has obvious significance. A helmsman can generate the BEV layout of the waterway using his/her eyes only. To simulate this intelligence, a novel neural network-based algorithm named Waterway-BEV is proposed, which enables reconstructing a local map formed by the waterway layout and ship occupancies in the bird’s-eye view given a first person view monocular image only. Waterway-BEV employs an efficient SEResNeXt encoder to extract features from first person view (FPV) monocular images, capturing deep semantic information related to waterways and ships. Due to the variations in information across different perspectives, Waterway-BEV incorporates a Cross-View Transformation Module, which takes the constraint of cycle consistency between views into account and makes full use of their correlation to strengthen the view transformation and scene understanding. To fully leverage the feature output of the SEResNeXt encoder, Waterway-BEV employs a decoder based on a dedicated lightweight network. This decoder is responsible for decoding the enhanced bird’s-eye view (BEV) feature maps and generating the BEV layout. By employing the Focal Loss as the loss function for model optimization, Waterway-BEV takes into account the quantity and classification difficulty of ship samples during the training process, thereby improving the generation performance and convergence speed. The experiments demonstrated that Waterway-BEV achieved notable performance metrics, with mIOU and mAP rates reaching 97.8% and 98.2%, respectively, in waterway bird’s-eye view layout generation. Waterway-BEV outperformed other state-of-the-art (SOTA) algorithms in generating BEV layouts of waterways. In particular, during specialized scenarios such as crossroads of waterways and tasks involving small target ships, Waterway-BEV consistently generated satisfactory bird’s-eye view layouts, demonstrating robustness and applicability.
Förderung
- National Key Research and Development Program of China
- National Natural Science Foundation of China
- Research on the Implementation Plan of the New Generation Shipping System in Pingdingshan, Luohe, and Zhoukou
Zitieren
APA
Ma, F., Jiang, X., Chen, C., Sun, J., Yan, X., & Wang, J. (2025). Waterway-BEV: Generate Bird’s Eye View Layouts of a Waterway From a First-Person View Camera Using Cross-View Transformers. IEEE Transactions on Intelligent Transportation Systems, 26(6), 8078-8096. https://doi.org/10.1109/tits.2025.3554717
Vancouver
Ma F, Jiang X, Chen C, Sun J, Yan X, Wang J. Waterway-BEV: Generate Bird’s Eye View Layouts of a Waterway From a First-Person View Camera Using Cross-View Transformers. IEEE Transactions on Intelligent Transportation Systems. 2025;26(6):8078-8096. doi:10.1109/tits.2025.3554717
BibTeX
@article{Ma2025,
author = {Ma, Feng and Jiang, Xin and Chen, Chen and Sun, Jie and Yan, Xin-Ping and Wang, Jin},
title = {Waterway-BEV: Generate Bird’s Eye View Layouts of a Waterway From a First-Person View Camera Using Cross-View Transformers},
journal = {IEEE Transactions on Intelligent Transportation Systems},
year = {2025},
volume = {26},
number = {6},
pages = {8078--8096},
doi = {10.1109/tits.2025.3554717}
}
EUVIMED