EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

SAR-to-Optical Image Translation via an Interpretable Network

Mingjin Zhang, Peng Zhang, Yuhan Zhang, Minghai Yang, Xiaofeng Li, Xiaogang Dong, Luchang Yang

Remote Sensing · 08.01.2024 · 16 (2) · 242

DOI: 10.3390/rs16020242 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 08.01.2024. Verfasst von Mingjin Zhang und 6 weiteren Autor:innen. Die Arbeit wurde bisher 32-mal zitiert (Crossref) und nennt 74 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Young Elite Scientists Sponsorship Program by CAST, Joint Laboratory for Innovation in Satellite-Borne Computers and Electronics Technology Open Fund 2023.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Synthetic aperture radar (SAR) is prevalent in the remote sensing field but is difficult to interpret by human visual perception. Recently, SAR-to-optical (S2O) image conversion methods have provided a prospective solution. However, since there is a substantial domain difference between optical and SAR images, they suffer from low image quality and geometric distortion in the produced optical images. Motivated by the analogy between pixels during the S2O image translation and molecules in a heat field, a thermodynamics-inspired network for SAR-to-optical image translation (S2O-TDN) is proposed in this paper. Specifically, we design a third-order finite difference (TFD) residual structure in light of the TFD equation of thermodynamics, which allows us to efficiently extract inter-domain invariant features and facilitate the learning of nonlinear translation mapping. In addition, we exploit the first law of thermodynamics (FLT) to devise an FLT-guided branch that promotes the state transition of the feature values from an unstable diffusion state to a stable one, aiming to regularize the feature diffusion and preserve image structures during S2O image translation. S2O-TDN follows an explicit design principle derived from thermodynamic theory and enjoys the advantage of explainability. Experiments on the public SEN1-2 dataset show the advantages of the proposed S2O-TDN over the current methods with more delicate textures and higher quantitative results.

Förderung

  • National Natural Science Foundation of China
  • Young Elite Scientists Sponsorship Program by CAST
  • Joint Laboratory for Innovation in Satellite-Borne Computers and Electronics Technology Open Fund 2023

Zitieren

APA

Zhang, M., Zhang, P., Zhang, Y., Yang, M., Li, X., Dong, X., & Yang, L. (2024). SAR-to-Optical Image Translation via an Interpretable Network. Remote Sensing, 16(2), 242. https://doi.org/10.3390/rs16020242

Vancouver

Zhang M, Zhang P, Zhang Y, Yang M, Li X, Dong X, et al. SAR-to-Optical Image Translation via an Interpretable Network. Remote Sensing. 2024;16(2):242. doi:10.3390/rs16020242

BibTeX
@article{Zhang2024,
  author = {Zhang, Mingjin and Zhang, Peng and Zhang, Yuhan and Yang, Minghai and Li, Xiaofeng and Dong, Xiaogang and Yang, Luchang},
  title = {SAR-to-Optical Image Translation via an Interpretable Network},
  journal = {Remote Sensing},
  year = {2024},
  volume = {16},
  number = {2},
  pages = {242},
  doi = {10.3390/rs16020242}
}
Kostenlos starten →