Changen2: Multi-Temporal Remote Sensing Generative Change Foundation Model
IEEE Transactions on Pattern Analysis and Machine Intelligence · 2025-02 · 47 (2) · 725-741
DOI: 10.1109/tpami.2024.3475824 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2025-02. Verfasst von Zhuo Zheng und 4 weiteren Autor:innen. Die Arbeit wurde bisher 73-mal zitiert (Crossref) und nennt 82 Literaturangaben. Gefördert von: ARO, ONR, CZ Biohub.
Abstract (Originalsprache)
Our understanding of the temporal dynamics of the Earth's surface has been significantly advanced by deep vision models, which often require a massive amount of labeled multi-temporal images for training. However, collecting, preprocessing, and annotating multi-temporal remote sensing images at scale is non-trivial since it is expensive and knowledge-intensive. In this paper, we present scalable multi-temporal change data generators based on generative models, which are cheap and automatic, alleviating these data problems. Our main idea is to simulate a stochastic change process over time. We describe the stochastic change process as a probabilistic graphical model, namely the generative probabilistic change model (GPCM), which factorizes the complex simulation problem into two more tractable sub-problems, i.e., condition-level change event simulation and image-level semantic change synthesis. To solve these two problems, we present Changen2, a GPCM implemented with a resolution-scalable diffusion transformer which can generate time series of remote sensing images and corresponding semantic and change labels from labeled and even unlabeled single-temporal images. Changen2 is a "generative change foundation model" that can be trained at scale via self-supervision, and is capable of producing change supervisory signals from unlabeled single-temporal images. Unlike existing "foundation models", our generative change foundation model synthesizes change data to train task-specific foundation models for change detection. The resulting model possesses inherent zero-shot change detection capabilities and excellent transferability. Comprehensive experiments suggest Changen2 has superior spatiotemporal scalability in data generation, e.g., Changen2 model trained on 256 pixel single-temporal images can yield time series of any length and resolutions of 1,024 pixels. Changen2 pre-trained models exhibit superior zero-shot performance (narrowing the performance gap to 3% on LEVIR-CD and approximately 10% on both S2Looking and SECOND, compared to fully supervised counterpart) and transferability across multiple types of change tasks, including ordinary and off-nadir building change, land-use/land-cover change, and disaster assessment.
Förderung
- ARO
- ONR
- CZ Biohub
- National Natural Science Foundation of China
Zitieren
APA
Zheng, Z., Ermon, S., Kim, D., Zhang, L., & Zhong, Y. (2025). Changen2: Multi-Temporal Remote Sensing Generative Change Foundation Model. IEEE Transactions on Pattern Analysis and Machine Intelligence, 47(2), 725-741. https://doi.org/10.1109/tpami.2024.3475824
Vancouver
Zheng Z, Ermon S, Kim D, Zhang L, Zhong Y. Changen2: Multi-Temporal Remote Sensing Generative Change Foundation Model. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2025;47(2):725-741. doi:10.1109/tpami.2024.3475824
BibTeX
@article{Zheng2025,
author = {Zheng, Zhuo and Ermon, Stefano and Kim, Dongjun and Zhang, Liangpei and Zhong, Yanfei},
title = {Changen2: Multi-Temporal Remote Sensing Generative Change Foundation Model},
journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
year = {2025},
volume = {47},
number = {2},
pages = {725--741},
doi = {10.1109/tpami.2024.3475824}
}
EUVIMED