EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

An Adaptive Polyline-Path Mask Attention for Hyperspectral and Multispectral Image Fusion

Xin Lyu, Chenchen Xia, Wenjun Xie, Sai Wang, Xin Li, Zhennan Xu, Caifeng Wu, Yiwei Fang

Remote Sensing · 03.08.2026 · 18 (15) · 2536

DOI: 10.3390/rs18152536 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 03.08.2026. Verfasst von Xin Lyu und 7 weiteren Autor:innen. Die Arbeit nennt 87 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Key Research and Development Program of China, National Natural Science Foundation of China, Natural Science Foundation of Jiangsu Province.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Reconstructing high-resolution hyperspectral images (HR-HSIs) from low-resolution hyperspectral images (LR-HSIs) and high-resolution multispectral images (HR-MSIs) is an important multimodal remote sensing task for applications requiring both fine spatial details and reliable spectral characterization. However, existing Transformer-based HSI–MSI fusion methods still face difficulty in jointly preserving geometric structures and spectral continuity. Specifically, flattening two-dimensional image structures into one-dimensional token sequences tends to weaken local spatial connectivity, while standard self-attention does not explicitly model inter-band dependency, which may lead to structural distortion and spectral inconsistency in the fused results. To address these issues, this paper proposes an Adaptive Polyline Path Masked Attention Network (AdaPPMA-Net) for HSI-MSI fusion. First, an Adaptive Polyline Path Masked Attention mechanism is developed to explicitly encode horizontal and vertical geometric continuity, while a gating strategy is introduced to adaptively regulate positional constraints and suppress redundant dependencies. Second, a spectral enhancement module is embedded into the Transformer block to strengthen inter-band dependency modeling and alleviate the loss of spectral continuity during token interaction. Third, a spatial–spectral refinement (SSRefine) module is designed to recalibrate fused spatial–spectral representations, thereby improving reconstruction quality in the decoding stage. Extensive experiments on four public datasets demonstrate that AdaPPMA-Net consistently outperforms several state-of-the-art methods across multiple quantitative metrics. In particular, on the Washington DC Mall dataset, the proposed method raises PSNR by 4.2975 dB and lowers RMSE, ERGAS, and SAM by 39.03%, 39.35%, and 38.02%, respectively, compared with the strongest competing method. These results indicate that AdaPPMA-Net provides a more effective solution for high-fidelity multimodal remote sensing fusion.

Förderung

  • National Key Research and Development Program of China
  • National Natural Science Foundation of China
  • Natural Science Foundation of Jiangsu Province

Zitieren

APA

Lyu, X., Xia, C., Xie, W., Wang, S., Li, X., Xu, Z., Wu, C., & Fang, Y. (2026). An Adaptive Polyline-Path Mask Attention for Hyperspectral and Multispectral Image Fusion. Remote Sensing, 18(15), 2536. https://doi.org/10.3390/rs18152536

Vancouver

Lyu X, Xia C, Xie W, Wang S, Li X, Xu Z, et al. An Adaptive Polyline-Path Mask Attention for Hyperspectral and Multispectral Image Fusion. Remote Sensing. 2026;18(15):2536. doi:10.3390/rs18152536

BibTeX
@article{Lyu2026,
  author = {Lyu, Xin and Xia, Chenchen and Xie, Wenjun and Wang, Sai and Li, Xin and Xu, Zhennan and Wu, Caifeng and Fang, Yiwei},
  title = {An Adaptive Polyline-Path Mask Attention for Hyperspectral and Multispectral Image Fusion},
  journal = {Remote Sensing},
  year = {2026},
  volume = {18},
  number = {15},
  pages = {2536},
  doi = {10.3390/rs18152536}
}
Kostenlos starten →