EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

SFT: Few-Shot Learning via Self-Supervised Feature Fusion With Transformer

Jit Yan Lim, Kian Ming Lim, Chin Poo Lee, Yong Xuan Tan

IEEE Access · 2024 · 12 · 86690-86703

DOI: 10.1109/access.2024.3416327 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Access, 2024. Verfasst von Jit Yan Lim und 3 weiteren Autor:innen. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 59 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: Fundamental Research Grant Scheme of the Ministry of Higher Education.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The few-shot learning paradigm aims to generalize to unseen tasks with limited samples. However, a focus solely on class-level discrimination may fall short of achieving robust generalization, especially when neglecting instance diversity and discriminability. This study introduces a metric-based few-shot approach, named Self-supervised Feature Fusion with Transformer (SFT), which integrates self-supervised learning with a transformer. SFT addresses the limitations of previous approaches by employing two distinct self-supervised tasks in separate models during pre-training, thus enhancing both instance diversity and discriminability in the feature space. The training process unfolds in two stages: pre-training and transfer learning. In pre-training, each model undergoes training with specific self-supervised tasks to harness the benefits of enhanced feature space. In the subsequent transfer learning stage, model weights are frozen, acting as feature extractors. The features from both models are amalgamated using a feature fusion technique and are transformed into task-specific features by a transformer, boosting discrimination on unseen tasks. The combined features enable the model to learn a well-generalized representation, effectively tackling the challenges posed by few-shot tasks. The proposed SFT method achieves state-of-the-art results on three benchmark datasets in few-shot image classification.

Förderung

  • Fundamental Research Grant Scheme of the Ministry of Higher Education

Zitieren

APA

Lim, J. Y., Lim, K. M., Lee, C. P., & Tan, Y. X. (2024). SFT: Few-Shot Learning via Self-Supervised Feature Fusion With Transformer. IEEE Access, 12, 86690-86703. https://doi.org/10.1109/access.2024.3416327

Vancouver

Lim JY, Lim KM, Lee CP, Tan YX. SFT: Few-Shot Learning via Self-Supervised Feature Fusion With Transformer. IEEE Access. 2024;12:86690-86703. doi:10.1109/access.2024.3416327

BibTeX
@article{Lim2024,
  author = {Lim, Jit Yan and Lim, Kian Ming and Lee, Chin Poo and Tan, Yong Xuan},
  title = {SFT: Few-Shot Learning via Self-Supervised Feature Fusion With Transformer},
  journal = {IEEE Access},
  year = {2024},
  volume = {12},
  pages = {86690--86703},
  doi = {10.1109/access.2024.3416327}
}
Kostenlos starten →