STSyn-BEV: BEV segmentation from surround-view fisheye cameras via spatio-temporal synchronization
Journal of King Saud University Computer and Information Sciences · 2026-07 · 38 (5)
DOI: 10.1007/s44443-026-00601-0 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of King Saud University Computer and Information Sciences, online erschienen am 09.03.2026. Verfasst von Ping Liu und 2 weiteren Autor:innen. Die Arbeit nennt 43 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Natural Science Foundation of China, Shanghai Sailing Program, Fundamental Research Funds for the Central Universities.
Abstract (Originalsprache)
Bird’s-Eye-View (BEV) semantic segmentation is critical for environmental perception in autonomous driving. Surround-view fisheye camera systems are increasingly adopted to enlarge the perception range and eliminate blind spots. However, severe geometric distortions and frequent ego-motion make accurate spatio-temporal feature alignment across multiple views and timestamps challenging. Such misalignment often leads to semantic inconsistency and notable drops in BEV segmentation accuracy. Moreover, most existing methods overlook these alignment errors and apply semantic supervision only at the final output, resulting in suboptimal intermediate BEV representations. To address these challenges, we propose STSyn-BEV, a Spatio-Temporal Synchronized BEV segmentation framework for surround-view fisheye cameras. It comprises three key components: a Pose-Sync (pose-synchronized) encoder, a semantic consistency supervision module, and a stage-wise supervision decoder with heterogeneous pathways. First, the Pose-Sync encoder explicitly transforms multi-view fisheye features from previous poses and timestamps into a unified BEV space via geometric transformation, substantially improving geometric consistency and temporal alignment. Second, the semantic consistency supervision module applies region-level contrastive learning to aggregated BEV features, enhancing semantic discrimination particularly for long-tailed categories. Third, the deep supervised decoder employs heterogeneous pathways—attention-based for global semantic reasoning and convolution-based for fine-grained structural refinement—guided by stage-wise supervision, enabling improved BEV feature decoding without additional inference cost. Extensive experiments on the FB-SSEM dataset demonstrate that STSyn-BEV surpasses state-of-the-art fisheye image-based BEV segmentation methods, notably achieving a 6.25% mIoU improvement over the strongest fisheye-specific baseline.
Förderung
- Natural Science Foundation of China
- Shanghai Sailing Program
- Fundamental Research Funds for the Central Universities
Zitieren
APA
Liu, P., Shao, X., & Huang, L. (2026). STSyn-BEV: BEV segmentation from surround-view fisheye cameras via spatio-temporal synchronization. Journal of King Saud University Computer and Information Sciences, 38(5). https://doi.org/10.1007/s44443-026-00601-0
Vancouver
Liu P, Shao X, Huang L. STSyn-BEV: BEV segmentation from surround-view fisheye cameras via spatio-temporal synchronization. Journal of King Saud University Computer and Information Sciences. 2026;38(5). doi:10.1007/s44443-026-00601-0
BibTeX
@article{Liu2026,
author = {Liu, Ping and Shao, Xuan and Huang, Leming},
title = {STSyn-BEV: BEV segmentation from surround-view fisheye cameras via spatio-temporal synchronization},
journal = {Journal of King Saud University Computer and Information Sciences},
year = {2026},
volume = {38},
number = {5},
doi = {10.1007/s44443-026-00601-0}
}
EUVIMED