Joint Style and Layout Synthesizing: Toward Generalizable Remote Sensing Semantic Segmentation
IEEE Transactions on Circuits and Systems for Video Technology · 2025-05 · 35 (5) · 4055-4071
DOI: 10.1109/tcsvt.2024.3522936 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2025-05. Verfasst von Qi Zang und 5 weiteren Autor:innen. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 74 Literaturangaben. Gefördert von: National Natural Science Foundation of China, National Key Research and Development Program of China, Key Research and Development Program of Shannxi.
Abstract (Originalsprache)
This paper studies the domain generalized remote sensing semantic segmentation (RSSS), aiming to generalize a model trained only on the source domain to unseen domains. Existing methods in computer vision treat style information as domain characteristics to achieve domain-agnostic learning. Nevertheless, their generalizability to RSSS remains constrained, due to the incomplete consideration of domain characteristics. We argue that remote sensing scenes have layout differences beyond just style. Considering this, we devise a joint style and layout synthesizing framework, enabling the model to jointly learn out-of-domain samples synthesized from these two perspectives. For style, we estimate the variant intensities of per-class representations affected by domain shift and randomly sample within this modeled scope to reasonably expand the boundaries of style-carrying feature statistics. For layout, we explore potential scenes with diverse layouts in the source domain and propose granularity-fixed and granularity-learnable masks to perturb layouts, forcing the model to learn characteristics of objects rather than variable positions. The mask is designed to learn more context-robust representations by discovering difficult-to-recognize perturbation directions. Subsequently, we impose gradient angle constraints between the samples synthesized using the two ways to correct conflicting optimization directions. Extensive experiments demonstrate the superior generalization ability of our method over existing methods.
Förderung
- National Natural Science Foundation of China
- National Key Research and Development Program of China
- Key Research and Development Program of Shannxi
- Key Scientific Technological Innovation Research Project by Ministry of Education
Zitieren
APA
Zang, Q., Wang, S., Zhao, D., Zhong, Z., Hou, B., & Jiao, L. (2025). Joint Style and Layout Synthesizing: Toward Generalizable Remote Sensing Semantic Segmentation. IEEE Transactions on Circuits and Systems for Video Technology, 35(5), 4055-4071. https://doi.org/10.1109/tcsvt.2024.3522936
Vancouver
Zang Q, Wang S, Zhao D, Zhong Z, Hou B, Jiao L. Joint Style and Layout Synthesizing: Toward Generalizable Remote Sensing Semantic Segmentation. IEEE Transactions on Circuits and Systems for Video Technology. 2025;35(5):4055-4071. doi:10.1109/tcsvt.2024.3522936
BibTeX
@article{Zang2025,
author = {Zang, Qi and Wang, Shuang and Zhao, Dong and Zhong, Zhun and Hou, Biao and Jiao, Licheng},
title = {Joint Style and Layout Synthesizing: Toward Generalizable Remote Sensing Semantic Segmentation},
journal = {IEEE Transactions on Circuits and Systems for Video Technology},
year = {2025},
volume = {35},
number = {5},
pages = {4055--4071},
doi = {10.1109/tcsvt.2024.3522936}
}
EUVIMED