EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Review of Deep Transfer Learning and Recent Advancements

Mohammadreza Iman, Hamid Reza Arabnia, Khaled Rasheed

Technologies · 14.03.2023 · 11 (2) · 40

DOI: 10.3390/technologies11020040 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Technologies, online erschienen am 14.03.2023. Verfasst von Mohammadreza Iman und 2 weiteren Autor:innen. Die Arbeit wurde bisher 665-mal zitiert (Crossref) und nennt 53 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Deep learning has been the answer to many machine learning problems during the past two decades. However, it comes with two significant constraints: dependency on extensive labeled data and training costs. Transfer learning in deep learning, known as Deep Transfer Learning (DTL), attempts to reduce such reliance and costs by reusing obtained knowledge from a source data/task in training on a target data/task. Most applied DTL techniques are network/model-based approaches. These methods reduce the dependency of deep learning models on extensive training data and drastically decrease training costs. Moreover, the training cost reduction makes DTL viable on edge devices with limited resources. Like any new advancement, DTL methods have their own limitations, and a successful transfer depends on specific adjustments and strategies for different scenarios. This paper reviews the concept, definition, and taxonomy of deep transfer learning and well-known methods. It investigates the DTL approaches by reviewing applied DTL techniques in the past five years and a couple of experimental analyses of DTLs to discover the best practice for using DTL in different scenarios. Moreover, the limitations of DTLs (catastrophic forgetting dilemma and overly biased pre-trained models) are discussed, along with possible solutions and research trends.

Zitieren

APA

Iman, M., Arabnia, H. R., & Rasheed, K. (2023). A Review of Deep Transfer Learning and Recent Advancements. Technologies, 11(2), 40. https://doi.org/10.3390/technologies11020040

Vancouver

Iman M, Arabnia HR, Rasheed K. A Review of Deep Transfer Learning and Recent Advancements. Technologies. 2023;11(2):40. doi:10.3390/technologies11020040

BibTeX
@article{Iman2023,
  author = {Iman, Mohammadreza and Arabnia, Hamid Reza and Rasheed, Khaled},
  title = {A Review of Deep Transfer Learning and Recent Advancements},
  journal = {Technologies},
  year = {2023},
  volume = {11},
  number = {2},
  pages = {40},
  doi = {10.3390/technologies11020040}
}
Kostenlos starten →