SFT: Few-Shot Learning via Self-Supervised Feature Fusion With Transformer
IEEE Access · 2024 · 12 · 86690-86703
DOI: 10.1109/access.2024.3416327 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Access, 2024. Verfasst von Jit Yan Lim und 3 weiteren Autor:innen. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 59 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: Fundamental Research Grant Scheme of the Ministry of Higher Education.
Abstract (Originalsprache)
The few-shot learning paradigm aims to generalize to unseen tasks with limited samples. However, a focus solely on class-level discrimination may fall short of achieving robust generalization, especially when neglecting instance diversity and discriminability. This study introduces a metric-based few-shot approach, named Self-supervised Feature Fusion with Transformer (SFT), which integrates self-supervised learning with a transformer. SFT addresses the limitations of previous approaches by employing two distinct self-supervised tasks in separate models during pre-training, thus enhancing both instance diversity and discriminability in the feature space. The training process unfolds in two stages: pre-training and transfer learning. In pre-training, each model undergoes training with specific self-supervised tasks to harness the benefits of enhanced feature space. In the subsequent transfer learning stage, model weights are frozen, acting as feature extractors. The features from both models are amalgamated using a feature fusion technique and are transformed into task-specific features by a transformer, boosting discrimination on unseen tasks. The combined features enable the model to learn a well-generalized representation, effectively tackling the challenges posed by few-shot tasks. The proposed SFT method achieves state-of-the-art results on three benchmark datasets in few-shot image classification.
Förderung
- Fundamental Research Grant Scheme of the Ministry of Higher Education
Zitieren
APA
Lim, J. Y., Lim, K. M., Lee, C. P., & Tan, Y. X. (2024). SFT: Few-Shot Learning via Self-Supervised Feature Fusion With Transformer. IEEE Access, 12, 86690-86703. https://doi.org/10.1109/access.2024.3416327
Vancouver
Lim JY, Lim KM, Lee CP, Tan YX. SFT: Few-Shot Learning via Self-Supervised Feature Fusion With Transformer. IEEE Access. 2024;12:86690-86703. doi:10.1109/access.2024.3416327
BibTeX
@article{Lim2024,
author = {Lim, Jit Yan and Lim, Kian Ming and Lee, Chin Poo and Tan, Yong Xuan},
title = {SFT: Few-Shot Learning via Self-Supervised Feature Fusion With Transformer},
journal = {IEEE Access},
year = {2024},
volume = {12},
pages = {86690--86703},
doi = {10.1109/access.2024.3416327}
}
EUVIMED