DynamicAug: Enhancing Transfer Learning Through Dynamic Data Augmentation Strategies Based on Model State
Neural Processing Letters · 20.05.2024 · 56 (3)
DOI: 10.1007/s11063-024-11626-9 ↗Kurz gefasst
Fachartikel in der Zeitschrift Neural Processing Letters, online erschienen am 20.05.2024. Verfasst von Xinyi Yu und 5 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 53 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Transfer learning has made significant advancements, however, the issue of overfitting continues to pose a major challenge. Data augmentation has emerged as a highly promising technique to counteract this challenge. Current data augmentation methods are fixed in nature, requiring manual determination of the appropriate intensity prior to the training process. However, this entails substantial computational costs. Additionally, as the model approaches convergence, static data augmentation strategies can become suboptimal. In this paper, we introduce the concept of Dynamic Data Augmentation (DynamicAug), a method that autonomously adjusts the intensity of data augmentation, taking into account the convergence state of the model. During each iteration of the model’s forward pass, we utilize a Gaussian distribution based sampler to stochastically sample the current intensity of data augmentation. To ensure that the sampled intensity is aligned with the convergence state of the model, we introduce a learnable expectation to the sampler and update the expectation iteratively. In order to assess the convergence status of the model, we introduce a novel loss function called the convergence loss. Through extensive experiments conducted over 27 vision datasets, we have demonstrated that DynamicAug can significantly enhance the performance of existing transfer learning methods.
Zitieren
APA
Yu, X., Zhao, H., Zhang, M., Wei, Y., Zhou, L., & Ou, L. (2024). DynamicAug: Enhancing Transfer Learning Through Dynamic Data Augmentation Strategies Based on Model State. Neural Processing Letters, 56(3). https://doi.org/10.1007/s11063-024-11626-9
Vancouver
Yu X, Zhao H, Zhang M, Wei Y, Zhou L, Ou L. DynamicAug: Enhancing Transfer Learning Through Dynamic Data Augmentation Strategies Based on Model State. Neural Processing Letters. 2024;56(3). doi:10.1007/s11063-024-11626-9
BibTeX
@article{Yu2024,
author = {Yu, Xinyi and Zhao, Haodong and Zhang, Mingyang and Wei, Yan and Zhou, Libo and Ou, Linlin},
title = {DynamicAug: Enhancing Transfer Learning Through Dynamic Data Augmentation Strategies Based on Model State},
journal = {Neural Processing Letters},
year = {2024},
volume = {56},
number = {3},
doi = {10.1007/s11063-024-11626-9}
}
EUVIMED