EUVIMEDEUVIMED entdecken
Crossref

Frequency-Adaptive Pan-Sharpening with Mixture of Experts

Xuanhua He, Keyu Yan, Rui Li, Chengjun Xie, Jie Zhang, Man Zhou

Proceedings of the AAAI Conference on Artificial Intelligence · 24.03.2024 · 38 (3) · 2121-2129

DOI: 10.1609/aaai.v38i3.27984 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 24.03.2024. Verfasst von Xuanhua He und 5 weiteren Autor:innen. Die Arbeit wurde bisher 37-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Pan-sharpening involves reconstructing missing high-frequency information in multi-spectral images with low spatial resolution, using a higher-resolution panchromatic image as guidance. Although the inborn connection with frequency domain, existing pan-sharpening research has not almost investigated the potential solution upon frequency domain. To this end, we propose a novel Frequency Adaptive Mixture of Experts (FAME) learning framework for pan-sharpening, which consists of three key components: the Adaptive Frequency Separation Prediction Module, the Sub-Frequency Learning Expert Module, and the Expert Mixture Module. In detail, the first leverages the discrete cosine transform to perform frequency separation by predicting the frequency mask. On the basis of generated mask, the second with low-frequency MOE and high-frequency MOE takes account for enabling the effective low-frequency and high-frequency information reconstruction. Followed by, the final fusion module dynamically weights high frequency and low-frequency MOE knowledge to adapt to remote sensing images with significant content variations. Quantitative and qualitative experiments over multiple datasets demonstrate that our method performs the best against other state-of-the-art ones and comprises a strong generalization ability for real-world scenes. Code will be made publicly at https://github.com/alexhe101/FAME-Net.

Zitieren

APA

He, X., Yan, K., Li, R., Xie, C., Zhang, J., & Zhou, M. (2024). Frequency-Adaptive Pan-Sharpening with Mixture of Experts. Proceedings of the AAAI Conference on Artificial Intelligence, 38(3), 2121-2129. https://doi.org/10.1609/aaai.v38i3.27984

Vancouver

He X, Yan K, Li R, Xie C, Zhang J, Zhou M. Frequency-Adaptive Pan-Sharpening with Mixture of Experts. Proceedings of the AAAI Conference on Artificial Intelligence. 2024;38(3):2121-2129. doi:10.1609/aaai.v38i3.27984

BibTeX
@article{He2024,
  author = {He, Xuanhua and Yan, Keyu and Li, Rui and Xie, Chengjun and Zhang, Jie and Zhou, Man},
  title = {Frequency-Adaptive Pan-Sharpening with Mixture of Experts},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2024},
  volume = {38},
  number = {3},
  pages = {2121--2129},
  doi = {10.1609/aaai.v38i3.27984}
}
Kostenlos starten →