EUVIMEDEUVIMED entdecken
Crossref

MMMamba: A Versatile Cross-Modal in Context Fusion Framework for Pan-Sharpening and Zero-Shot Image Enhancement

Yingying Wang, Xuanhua He, Chen Wu, Jialing Huang, Suiyun Zhang, Rui Liu, Xinghao Ding, Haoxuan Che

Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (22) · 18656-18664

DOI: 10.1609/aaai.v40i22.38933 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Yingying Wang und 7 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Pan-sharpening aims to generate high-resolution multispectral (HRMS) images by integrating a high-resolution panchromatic (PAN) image with its corresponding low-resolution multispectral (MS) image. To achieve effective fusion, it is crucial to fully exploit the complementary information between the two modalities. Traditional CNN-based methods typically rely on channel-wise concatenation with fixed convolutional operators, which limits their adaptability to diverse spatial and spectral variations. While cross-attention mechanisms enable global interactions, they are computationally inefficient and may dilute fine-grained correspondences, making it difficult to capture complex semantic relationships. Recent advances in the Multimodal Diffusion Transformer (MMDiT) architecture have demonstrated impressive success in image generation and editing tasks. Unlike cross-attention, MMDiT employs in-context conditioning to facilitate more direct and efficient cross-modal information exchange. In this paper, we propose MMMamba, a cross-modal in-context fusion framework for pan-sharpening, with the flexibility to support image super-resolution in a zero-shot manner. Built upon the Mamba architecture, our design ensures linear computational complexity while maintaining strong cross-modal interaction capacity. Furthermore, we introduce a novel multimodal interleaved (MI) scanning mechanism that facilitates effective information exchange between the PAN and MS modalities. Extensive experiments demonstrate the superior performance of our method compared to existing state-of-the-art (SOTA) techniques across multiple tasks and benchmarks.

Zitieren

APA

Wang, Y., He, X., Wu, C., Huang, J., Zhang, S., Liu, R., Ding, X., & Che, H. (2026). MMMamba: A Versatile Cross-Modal in Context Fusion Framework for Pan-Sharpening and Zero-Shot Image Enhancement. Proceedings of the AAAI Conference on Artificial Intelligence, 40(22), 18656-18664. https://doi.org/10.1609/aaai.v40i22.38933

Vancouver

Wang Y, He X, Wu C, Huang J, Zhang S, Liu R, et al. MMMamba: A Versatile Cross-Modal in Context Fusion Framework for Pan-Sharpening and Zero-Shot Image Enhancement. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(22):18656-18664. doi:10.1609/aaai.v40i22.38933

BibTeX
@article{Wang2026,
  author = {Wang, Yingying and He, Xuanhua and Wu, Chen and Huang, Jialing and Zhang, Suiyun and Liu, Rui and Ding, Xinghao and Che, Haoxuan},
  title = {MMMamba: A Versatile Cross-Modal in Context Fusion Framework for Pan-Sharpening and Zero-Shot Image Enhancement},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2026},
  volume = {40},
  number = {22},
  pages = {18656--18664},
  doi = {10.1609/aaai.v40i22.38933}
}
Kostenlos starten →