A Review of Deep Transfer Learning and Recent Advancements
Technologies · 14.03.2023 · 11 (2) · 40
DOI: 10.3390/technologies11020040 ↗Kurz gefasst
Fachartikel in der Zeitschrift Technologies, online erschienen am 14.03.2023. Verfasst von Mohammadreza Iman und 2 weiteren Autor:innen. Die Arbeit wurde bisher 665-mal zitiert (Crossref) und nennt 53 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Deep learning has been the answer to many machine learning problems during the past two decades. However, it comes with two significant constraints: dependency on extensive labeled data and training costs. Transfer learning in deep learning, known as Deep Transfer Learning (DTL), attempts to reduce such reliance and costs by reusing obtained knowledge from a source data/task in training on a target data/task. Most applied DTL techniques are network/model-based approaches. These methods reduce the dependency of deep learning models on extensive training data and drastically decrease training costs. Moreover, the training cost reduction makes DTL viable on edge devices with limited resources. Like any new advancement, DTL methods have their own limitations, and a successful transfer depends on specific adjustments and strategies for different scenarios. This paper reviews the concept, definition, and taxonomy of deep transfer learning and well-known methods. It investigates the DTL approaches by reviewing applied DTL techniques in the past five years and a couple of experimental analyses of DTLs to discover the best practice for using DTL in different scenarios. Moreover, the limitations of DTLs (catastrophic forgetting dilemma and overly biased pre-trained models) are discussed, along with possible solutions and research trends.
Zitieren
APA
Iman, M., Arabnia, H. R., & Rasheed, K. (2023). A Review of Deep Transfer Learning and Recent Advancements. Technologies, 11(2), 40. https://doi.org/10.3390/technologies11020040
Vancouver
Iman M, Arabnia HR, Rasheed K. A Review of Deep Transfer Learning and Recent Advancements. Technologies. 2023;11(2):40. doi:10.3390/technologies11020040
BibTeX
@article{Iman2023,
author = {Iman, Mohammadreza and Arabnia, Hamid Reza and Rasheed, Khaled},
title = {A Review of Deep Transfer Learning and Recent Advancements},
journal = {Technologies},
year = {2023},
volume = {11},
number = {2},
pages = {40},
doi = {10.3390/technologies11020040}
}
EUVIMED