Knowledge Distillation in Image Classification: The Impact of Datasets
Computers · 24.07.2024 · 13 (8) · 184
DOI: 10.3390/computers13080184 ↗Kurz gefasst
Fachartikel in der Zeitschrift Computers, online erschienen am 24.07.2024. Verfasst von Ange Gabriel Belinga und 3 weiteren Autor:innen. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 49 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
As the demand for efficient and lightweight models in image classification grows, knowledge distillation has emerged as a promising technique to transfer expertise from complex teacher models to simpler student models. However, the efficacy of knowledge distillation is intricately linked to the choice of datasets used during training. Datasets are pivotal in shaping a model’s learning process, influencing its ability to generalize and discriminate between diverse patterns. While considerable research has independently explored knowledge distillation and image classification, a comprehensive understanding of how different datasets impact knowledge distillation remains a critical gap. This study systematically investigates the impact of diverse datasets on knowledge distillation in image classification. By varying dataset characteristics such as size, domain specificity, and inherent biases, we aim to unravel the nuanced relationship between datasets and the efficacy of knowledge transfer. Our experiments employ a range of datasets to comprehensively explore their impact on the performance gains achieved through knowledge distillation. This study contributes valuable guidance for researchers and practitioners seeking to optimize image classification models through kno-featured applications. By elucidating the intricate interplay between dataset characteristics and knowledge distillation outcomes, our findings empower the community to make informed decisions when selecting datasets, ultimately advancing the field toward more robust and efficient model development.
Zitieren
APA
Belinga, A. G., Koumetio, C. S. T., Haziti, M. E., & Hassouni, M. E. (2024). Knowledge Distillation in Image Classification: The Impact of Datasets. Computers, 13(8), 184. https://doi.org/10.3390/computers13080184
Vancouver
Belinga AG, Koumetio CST, Haziti ME, Hassouni ME. Knowledge Distillation in Image Classification: The Impact of Datasets. Computers. 2024;13(8):184. doi:10.3390/computers13080184
BibTeX
@article{Belinga2024,
author = {Belinga, Ange Gabriel and Koumetio, Cédric Stéphane Tekouabou and Haziti, Mohamed El and Hassouni, Mohammed El},
title = {Knowledge Distillation in Image Classification: The Impact of Datasets},
journal = {Computers},
year = {2024},
volume = {13},
number = {8},
pages = {184},
doi = {10.3390/computers13080184}
}
EUVIMED