EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

STSyn-BEV: BEV segmentation from surround-view fisheye cameras via spatio-temporal synchronization

Ping Liu, Xuan Shao, Leming Huang

Journal of King Saud University Computer and Information Sciences · 2026-07 · 38 (5)

DOI: 10.1007/s44443-026-00601-0 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of King Saud University Computer and Information Sciences, online erschienen am 09.03.2026. Verfasst von Ping Liu und 2 weiteren Autor:innen. Die Arbeit nennt 43 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Natural Science Foundation of China, Shanghai Sailing Program, Fundamental Research Funds for the Central Universities.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Bird’s-Eye-View (BEV) semantic segmentation is critical for environmental perception in autonomous driving. Surround-view fisheye camera systems are increasingly adopted to enlarge the perception range and eliminate blind spots. However, severe geometric distortions and frequent ego-motion make accurate spatio-temporal feature alignment across multiple views and timestamps challenging. Such misalignment often leads to semantic inconsistency and notable drops in BEV segmentation accuracy. Moreover, most existing methods overlook these alignment errors and apply semantic supervision only at the final output, resulting in suboptimal intermediate BEV representations. To address these challenges, we propose STSyn-BEV, a Spatio-Temporal Synchronized BEV segmentation framework for surround-view fisheye cameras. It comprises three key components: a Pose-Sync (pose-synchronized) encoder, a semantic consistency supervision module, and a stage-wise supervision decoder with heterogeneous pathways. First, the Pose-Sync encoder explicitly transforms multi-view fisheye features from previous poses and timestamps into a unified BEV space via geometric transformation, substantially improving geometric consistency and temporal alignment. Second, the semantic consistency supervision module applies region-level contrastive learning to aggregated BEV features, enhancing semantic discrimination particularly for long-tailed categories. Third, the deep supervised decoder employs heterogeneous pathways—attention-based for global semantic reasoning and convolution-based for fine-grained structural refinement—guided by stage-wise supervision, enabling improved BEV feature decoding without additional inference cost. Extensive experiments on the FB-SSEM dataset demonstrate that STSyn-BEV surpasses state-of-the-art fisheye image-based BEV segmentation methods, notably achieving a 6.25% mIoU improvement over the strongest fisheye-specific baseline.

Förderung

  • Natural Science Foundation of China
  • Shanghai Sailing Program
  • Fundamental Research Funds for the Central Universities

Zitieren

APA

Liu, P., Shao, X., & Huang, L. (2026). STSyn-BEV: BEV segmentation from surround-view fisheye cameras via spatio-temporal synchronization. Journal of King Saud University Computer and Information Sciences, 38(5). https://doi.org/10.1007/s44443-026-00601-0

Vancouver

Liu P, Shao X, Huang L. STSyn-BEV: BEV segmentation from surround-view fisheye cameras via spatio-temporal synchronization. Journal of King Saud University Computer and Information Sciences. 2026;38(5). doi:10.1007/s44443-026-00601-0

BibTeX
@article{Liu2026,
  author = {Liu, Ping and Shao, Xuan and Huang, Leming},
  title = {STSyn-BEV: BEV segmentation from surround-view fisheye cameras via spatio-temporal synchronization},
  journal = {Journal of King Saud University Computer and Information Sciences},
  year = {2026},
  volume = {38},
  number = {5},
  doi = {10.1007/s44443-026-00601-0}
}
Kostenlos starten →