EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Dynamic Expansion Mixture-of-Experts with Pre-Trained Vision Transformer for Few-Shot Class-Incremental Remote Sensing Scene Classification

Yunhao Wu, Xiang Li, Jianlin Zhang, Haorui Zuo, Hui Li, Tong Tan

Remote Sensing · 12.04.2026 · 18 (8) · 1145

DOI: 10.3390/rs18081145 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 12.04.2026. Verfasst von Yunhao Wu und 5 weiteren Autor:innen. Die Arbeit nennt 58 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Frontier Research Fund of Institute of Optics and Electronics, China Academy of Sciences.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Few-Shot Class-Incremental Learning (FSCIL) aims to sequentially learn new classes from very few labelled samples while preventing the forgetting of previously acquired knowledge, which has important practical value for remote sensing scene classification (RSSC). Recent studies have shown that applying a Vision Transformer (ViT) pre-trained on natural image datasets to FSCIL tasks can achieve significantly superior performance. Nevertheless, a substantial domain distribution gap exists between natural images and remote sensing images, which leads to severe performance degradation when such models are directly transferred to RSSC. To address the domain gap alongside FSCIL’s inherent stability–plasticity dilemma and overfitting under data scarcity, we propose a Dynamic Expansion Mixture-of-Experts with Pre-trained Vision Transformer (DEM-ViT) framework. Specifically, to alleviate the domain discrepancy, DEM-ViT incorporates an Adapter-Based Mixture-of-Experts (ABMoE) module, which captures the diverse visual patterns of remote sensing scenes through feature reconstruction in the representation space and collaborative learning among multiple experts. Furthermore, to address the stability–plasticity dilemma in FSCIL, we propose a Dynamic Expert Expansion (DEE) strategy, which progressively expands the model capacity along the incremental sessions. DEE provides sufficient space for learning new knowledge while mitigating the forgetting of previous knowledge. In addition, we propose a Semantic-Guided Feature Alignment (SGFA) method to reduce the risk of overfitting under data-scarce conditions. SGFA leverages textual information to construct robust text prototypes and uses them to calibrate the visual feature space. Extensive experiments across three benchmarks indicate that our framework exhibits highly competitive performance compared with state-of-the-art methods.

Förderung

  • Frontier Research Fund of Institute of Optics and Electronics, China Academy of Sciences

Zitieren

APA

Wu, Y., Li, X., Zhang, J., Zuo, H., Li, H., & Tan, T. (2026). Dynamic Expansion Mixture-of-Experts with Pre-Trained Vision Transformer for Few-Shot Class-Incremental Remote Sensing Scene Classification. Remote Sensing, 18(8), 1145. https://doi.org/10.3390/rs18081145

Vancouver

Wu Y, Li X, Zhang J, Zuo H, Li H, Tan T. Dynamic Expansion Mixture-of-Experts with Pre-Trained Vision Transformer for Few-Shot Class-Incremental Remote Sensing Scene Classification. Remote Sensing. 2026;18(8):1145. doi:10.3390/rs18081145

BibTeX
@article{Wu2026,
  author = {Wu, Yunhao and Li, Xiang and Zhang, Jianlin and Zuo, Haorui and Li, Hui and Tan, Tong},
  title = {Dynamic Expansion Mixture-of-Experts with Pre-Trained Vision Transformer for Few-Shot Class-Incremental Remote Sensing Scene Classification},
  journal = {Remote Sensing},
  year = {2026},
  volume = {18},
  number = {8},
  pages = {1145},
  doi = {10.3390/rs18081145}
}
Kostenlos starten →