EUVIMEDEUVIMED entdecken
Crossref

Joint Spatial and Frequency Domain Learning for Lightweight Spectral Image Demosaicing

Fangfang Wu, Tao Huang, Junwei Xu, Xun Cao, Weisheng Dong, Le Dong, Guangming Shi

IEEE Transactions on Image Processing · 2025 · 34 · 1119-1132

DOI: 10.1109/tip.2025.3536217 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Image Processing, 2025. Verfasst von Fangfang Wu und 6 weiteren Autor:innen. Die Arbeit wurde bisher 19-mal zitiert (Crossref) und nennt 57 Literaturangaben. Gefördert von: Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Conventional spectral image demosaicing algorithms rely on pixels' spatial or spectral correlations for reconstruction. Due to the missing data in the multispectral filter array (MSFA), the estimation of spatial or spectral correlations is inaccurate, leading to poor reconstruction results, and these algorithms are time-consuming. Deep learning-based spectral image demosaicing methods directly learn the nonlinear mapping relationship between 2D spectral mosaic images and 3D multispectral images. However, these learning-based methods focused only on learning the mapping relationship in the spatial domain, but neglected valuable image information in the frequency domain, resulting in limited reconstruction quality. To address the above issues, this paper proposes a novel lightweight spectral image demosaicing method based on joint spatial and frequency domain information learning. First, a novel parameter-free spectral image initialization strategy based on the Fourier transform is proposed, which leads to better initialized spectral images and eases the difficulty of subsequent spectral image reconstruction. Furthermore, an efficient spatial-frequency transformer network is proposed, which jointly learns the spatial correlations and the frequency domain characteristics. Compared to existing learning-based spectral image demosaicing methods, the proposed method significantly reduces the number of model parameters and computational complexity. Extensive experiments on simulated and real-world data show that the proposed method notably outperforms existing spectral image demosaicing methods.

Förderung

  • Natural Science Foundation of China

Zitieren

APA

Wu, F., Huang, T., Xu, J., Cao, X., Dong, W., Dong, L., & Shi, G. (2025). Joint Spatial and Frequency Domain Learning for Lightweight Spectral Image Demosaicing. IEEE Transactions on Image Processing, 34, 1119-1132. https://doi.org/10.1109/tip.2025.3536217

Vancouver

Wu F, Huang T, Xu J, Cao X, Dong W, Dong L, et al. Joint Spatial and Frequency Domain Learning for Lightweight Spectral Image Demosaicing. IEEE Transactions on Image Processing. 2025;34:1119-1132. doi:10.1109/tip.2025.3536217

BibTeX
@article{Wu2025,
  author = {Wu, Fangfang and Huang, Tao and Xu, Junwei and Cao, Xun and Dong, Weisheng and Dong, Le and Shi, Guangming},
  title = {Joint Spatial and Frequency Domain Learning for Lightweight Spectral Image Demosaicing},
  journal = {IEEE Transactions on Image Processing},
  year = {2025},
  volume = {34},
  pages = {1119--1132},
  doi = {10.1109/tip.2025.3536217}
}
Kostenlos starten →