An Unsupervised CNN-Based Pansharpening Framework with Spectral-Spatial Fidelity Balance
Remote Sensing · 16.08.2024 · 16 (16) · 3014
DOI: 10.3390/rs16163014 ↗Kurz gefasst
Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 16.08.2024. Verfasst von Matteo Ciotola und 2 weiteren Autor:innen. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 72 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
In recent years, deep learning techniques for pansharpening multiresolution images have gained increasing interest. Due to the lack of ground truth data, most deep learning solutions rely on synthetic reduced-resolution data for supervised training. This approach has limitations due to the statistical mismatch between real full-resolution and synthetic reduced-resolution data, which affects the models’ generalization capacity. Consequently, there has been a shift towards unsupervised learning frameworks for pansharpening deep learning-based techniques. Unsupervised schemes require defining sophisticated loss functions with at least two components: one for spectral quality, ensuring consistency between the pansharpened image and the input multispectral component, and another for spatial quality, ensuring consistency between the output and the panchromatic input. Despite promising results, there has been limited investigation into the interaction and balance of these loss terms to ensure stability and accuracy. This work explores how unsupervised spatial and spectral consistency losses can be reliably combined preserving the outocome quality. By examining these interactions, we propose a general rule for balancing the two loss components to enhance the stability and performance of unsupervised pansharpening models. Experiments on three state-of-the-art algorithms using WorldView-3 images demonstrate that methods trained with the proposed framework achieve good performance in terms of visual quality and numerical indexes.
Zitieren
APA
Ciotola, M., Guarino, G., & Scarpa, G. (2024). An Unsupervised CNN-Based Pansharpening Framework with Spectral-Spatial Fidelity Balance. Remote Sensing, 16(16), 3014. https://doi.org/10.3390/rs16163014
Vancouver
Ciotola M, Guarino G, Scarpa G. An Unsupervised CNN-Based Pansharpening Framework with Spectral-Spatial Fidelity Balance. Remote Sensing. 2024;16(16):3014. doi:10.3390/rs16163014
BibTeX
@article{Ciotola2024,
author = {Ciotola, Matteo and Guarino, Giuseppe and Scarpa, Giuseppe},
title = {An Unsupervised CNN-Based Pansharpening Framework with Spectral-Spatial Fidelity Balance},
journal = {Remote Sensing},
year = {2024},
volume = {16},
number = {16},
pages = {3014},
doi = {10.3390/rs16163014}
}
EUVIMED