EUVIMEDEUVIMED entdecken
Crossref

Cross-Modal Visual Perception Consistency: A Language-Enhanced Approach for Heterogeneous Change Detection

Siyao Li, Weiying Xie, Jitao Ma, Leyuan Fang, Yunsong Li

IEEE Transactions on Circuits and Systems for Video Technology · 2026-08 · 36 (8) · 11459-11470

DOI: 10.1109/tcsvt.2026.3674926 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2026-08. Verfasst von Siyao Li und 4 weiteren Autor:innen. Die Arbeit nennt 45 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Fundamental and Interdisciplinary Disciplines Breakthrough Plan of the Ministry of Education of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Heterogeneous remote sensing image change detection (HRSICD) seeks to identify surface changes by comparing images captured at different times. However, CD faces significant challenges due to heterogeneity arising from varying sensor types and imaging conditions. Recently, powerful vision-language models like CLIP have emerged, with strong semantic decoding abilities. Opening new possibilities for using linguistic information as an auxiliary in visual tasks, potentially driving breakthroughs in HCD. Capitalizing on this prospect, we investigate graph learning with vision-language features and introduce LEVPC, the first language-enhanced visual perception consistency framework for HCD. First, we create a mutual information-guided graph aggregation module. Specifically, it builds modality-invariant structured relationships among visual nodes by using language features as connecting bridges, providing a consistent foundation for comparing changes. To reduce modeling bias from heterogeneity, language is used as an anchor to aggregate features, ensuring a unified expression of visual representations. In summary, language guides the generation and aggregation of multiple subgraphs from visual inputs, ultimately building robust representations of structural relationships within a shared semantic space. Moreover, a change semantic compensation module is introduced, which analyses the change intensity between bi-temporal data from a vision-language perspective. And then adds change-related semantic descriptions for salient change regions, enhancing the expressiveness of visual change features. Experiments on multiple datasets validate the superior performance of LEVPC in HCD, achieving an average increase of 2.6% in Kappa. The code will be publicly available at https://github.com/sylXIDIAN/LEVPC

Förderung

  • National Natural Science Foundation of China
  • Fundamental and Interdisciplinary Disciplines Breakthrough Plan of the Ministry of Education of China

Zitieren

APA

Li, S., Xie, W., Ma, J., Fang, L., & Li, Y. (2026). Cross-Modal Visual Perception Consistency: A Language-Enhanced Approach for Heterogeneous Change Detection. IEEE Transactions on Circuits and Systems for Video Technology, 36(8), 11459-11470. https://doi.org/10.1109/tcsvt.2026.3674926

Vancouver

Li S, Xie W, Ma J, Fang L, Li Y. Cross-Modal Visual Perception Consistency: A Language-Enhanced Approach for Heterogeneous Change Detection. IEEE Transactions on Circuits and Systems for Video Technology. 2026;36(8):11459-11470. doi:10.1109/tcsvt.2026.3674926

BibTeX
@article{Li2026,
  author = {Li, Siyao and Xie, Weiying and Ma, Jitao and Fang, Leyuan and Li, Yunsong},
  title = {Cross-Modal Visual Perception Consistency: A Language-Enhanced Approach for Heterogeneous Change Detection},
  journal = {IEEE Transactions on Circuits and Systems for Video Technology},
  year = {2026},
  volume = {36},
  number = {8},
  pages = {11459--11470},
  doi = {10.1109/tcsvt.2026.3674926}
}
Kostenlos starten →