ShareCMP: Polarization-Aware RGB-P Semantic Segmentation
IEEE Transactions on Circuits and Systems for Video Technology · 2025-10 · 35 (10) · 10316-10329
DOI: 10.1109/tcsvt.2025.3570764 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2025-10. Verfasst von Zhuoyan Liu und 4 weiteren Autor:innen. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 90 Literaturangaben. Gefördert von: National Natural Science Foundation of China, National Key Research and Development Program of China, National Key Laboratory Foundation of Autonomous Marine Vehicle Technology.
Abstract (Originalsprache)
Multimodal semantic segmentation is developing rapidly, but the modality of RGB-Polarization remains underexplored. To delve into this problem, we construct a UPLight RGB-P segmentation benchmark with 12 typical underwater semantic classes. In this work, we design the ShareCMP, an RGB-P semantic segmentation framework with a shared dual-branch architecture (ShareCMP Encoder), which reduces the parameters and memory space by about 33.8% compared to previous dual-branch models. It encompasses a Polarization Generate Attention (PGA) module designed to generate polarization modal images with richer polarization properties for the encoder. In addition, we introduce the Class Polarization-Aware Loss (CPALoss) with Class Polarization-Aware Auxiliary Head (CPAAHead) to improve the learning and understanding of the encoder for polarization modal information and to optimize the PGA module. With extensive experiments on a total of three RGB-P benchmarks, our ShareCMP achieves the best performance in mIoU with fewer parameters on the UPLight (92.45 (+0.32)%), ZJU (92.7 (+0.1)%), and MCubeS (50.99 (+1.51)%) datasets. And our ShareCMP (w/o PGA) achieves competitive or even higher performance on other RGB-X datasets compared to the corresponding state-of-the-art RGB-X methods. The code and datasets are available at https://github.com/LEFTeyex/ShareCMP
Förderung
- National Natural Science Foundation of China
- National Key Research and Development Program of China
- National Key Laboratory Foundation of Autonomous Marine Vehicle Technology
Zitieren
APA
Liu, Z., Wang, B., Wang, L., Mao, C., & Li, Y. (2025). ShareCMP: Polarization-Aware RGB-P Semantic Segmentation. IEEE Transactions on Circuits and Systems for Video Technology, 35(10), 10316-10329. https://doi.org/10.1109/tcsvt.2025.3570764
Vancouver
Liu Z, Wang B, Wang L, Mao C, Li Y. ShareCMP: Polarization-Aware RGB-P Semantic Segmentation. IEEE Transactions on Circuits and Systems for Video Technology. 2025;35(10):10316-10329. doi:10.1109/tcsvt.2025.3570764
BibTeX
@article{Liu2025,
author = {Liu, Zhuoyan and Wang, Bo and Wang, Lizhi and Mao, Chenyu and Li, Ye},
title = {ShareCMP: Polarization-Aware RGB-P Semantic Segmentation},
journal = {IEEE Transactions on Circuits and Systems for Video Technology},
year = {2025},
volume = {35},
number = {10},
pages = {10316--10329},
doi = {10.1109/tcsvt.2025.3570764}
}
EUVIMED