Toward Lightweight Diabetic Retinopathy Classification: A Knowledge Distillation Approach for Resource-Constrained Settings
Applied Sciences · 16.11.2023 · 13 (22) · 12397
DOI: 10.3390/app132212397 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 16.11.2023. Verfasst von Niful Islam und 5 weiteren Autor:innen. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 73 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: United International University.
Abstract (Originalsprache)
Diabetic retinopathy (DR), a consequence of diabetes, is one of the prominent contributors to blindness. Effective intervention necessitates accurate classification of DR; this is a need that computer vision-based technologies address. However, using large-scale deep learning models for DR classification presents difficulties, especially when integrating them into devices with limited resources, particularly in places with poor technological infrastructure. In order to address this, our research presents a knowledge distillation-based approach, where we train a fusion model, composed of ResNet152V2 and Swin Transformer, as the teacher model. The knowledge learned from the heavy teacher model is transferred to the lightweight student model of 102 megabytes, which consists of Xception with a customized convolutional block attention module (CBAM). The system also integrates a four-stage image enhancement technique to improve the image quality. We compared the model against eight state-of-the-art classifiers on five evaluation metrics; the experiments show superior performance of the model over other methods on two datasets (APTOS and IDRiD). The model performed exceptionally well on the APTOS dataset, achieving 100% accuracy in binary classification and 99.04% accuracy in multi-class classification. On the IDRiD dataset, the results were 98.05% for binary classification accuracy and 94.17% for multi-class accuracy. The proposed approach shows promise for practical applications, enabling accessible DR assessment even in technologically underdeveloped environments.
Förderung
- United International University
Zitieren
APA
Islam, N., Jony, M. M. H., Hasan, E., Sutradhar, S., Rahman, A., & Islam, M. M. (2023). Toward Lightweight Diabetic Retinopathy Classification: A Knowledge Distillation Approach for Resource-Constrained Settings. Applied Sciences, 13(22), 12397. https://doi.org/10.3390/app132212397
Vancouver
Islam N, Jony MMH, Hasan E, Sutradhar S, Rahman A, Islam MM. Toward Lightweight Diabetic Retinopathy Classification: A Knowledge Distillation Approach for Resource-Constrained Settings. Applied Sciences. 2023;13(22):12397. doi:10.3390/app132212397
BibTeX
@article{Islam2023,
author = {Islam, Niful and Jony, Md. Mehedi Hasan and Hasan, Emam and Sutradhar, Sunny and Rahman, Atikur and Islam, Md. Motaharul},
title = {Toward Lightweight Diabetic Retinopathy Classification: A Knowledge Distillation Approach for Resource-Constrained Settings},
journal = {Applied Sciences},
year = {2023},
volume = {13},
number = {22},
pages = {12397},
doi = {10.3390/app132212397}
}
EUVIMED