EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Multimodal meta-learning through meta-learned task representations

Anna Vettoruzzo, Mohamed-Rafik Bouguelia, Thorsteinn Rögnvaldsson

Neural Computing and Applications · 2024-05 · 36 (15) · 8519-8529

DOI: 10.1007/s00521-024-09540-1 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Neural Computing and Applications, online erschienen am 23.02.2024. Verfasst von Anna Vettoruzzo und 2 weiteren Autor:innen. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Halmstad University.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Few-shot meta-learning involves training a model on multiple tasks to enable it to efficiently adapt to new, previously unseen tasks with only a limited number of samples. However, current meta-learning methods assume that all tasks are closely related and belong to a common domain, whereas in practice, tasks can be highly diverse and originate from multiple domains, resulting in a multimodal task distribution. This poses a challenge for existing methods as they struggle to learn a shared representation that can be easily adapted to all tasks within the distribution. To address this challenge, we propose a meta-learning framework that can handle multimodal task distributions by conditioning the model on the current task, resulting in a faster adaptation. Our proposed method learns to encode each task and generate task embeddings that modulate the model’s activations. The resulting modulated model become specialized for the current task and leads to more effective adaptation. Our framework is designed to work in a realistic setting where the mode from which a task is sampled is unknown. Nonetheless, we also explore the possibility of incorporating auxiliary information, such as the task-mode-label, to further enhance the performance of our method if such information is available. We evaluate our proposed framework on various few-shot regression and image classification tasks, demonstrating its superiority over other state-of-the-art meta-learning methods. The results highlight the benefits of learning to embed task-specific information in the model to guide the adaptation when tasks are sampled from a multimodal distribution.

Förderung

  • Halmstad University

Zitieren

APA

Vettoruzzo, A., Bouguelia, M., & Rögnvaldsson, T. (2024). Multimodal meta-learning through meta-learned task representations. Neural Computing and Applications, 36(15), 8519-8529. https://doi.org/10.1007/s00521-024-09540-1

Vancouver

Vettoruzzo A, Bouguelia M, Rögnvaldsson T. Multimodal meta-learning through meta-learned task representations. Neural Computing and Applications. 2024;36(15):8519-8529. doi:10.1007/s00521-024-09540-1

BibTeX
@article{Vettoruzzo2024,
  author = {Vettoruzzo, Anna and Bouguelia, Mohamed-Rafik and Rögnvaldsson, Thorsteinn},
  title = {Multimodal meta-learning through meta-learned task representations},
  journal = {Neural Computing and Applications},
  year = {2024},
  volume = {36},
  number = {15},
  pages = {8519--8529},
  doi = {10.1007/s00521-024-09540-1}
}
Kostenlos starten →