Knowledge Distillation for Lightweight and Explainable Intrusion Detection in Resource-Constrained Consumer Devices
IEEE Transactions on Consumer Electronics · 2025-11 · 71 (4) · 12157-12165
DOI: 10.1109/tce.2025.3601183 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Consumer Electronics, 2025-11. Verfasst von Muhammad Umair und 6 weiteren Autor:innen. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 19 Literaturangaben. Gefördert von: Deanship of Research and Graduate Studies at King Khalid University, Large Research Project.
Abstract (Originalsprache)
The growing demand for deploying deep learning (DL) models for cyber-attack detection on consumer devices is constrained by their limited memory and computational resources. High-performing DL models are often too resource-intensive for on-device deployment. Knowledge distillation (KD) offers an alternative by transferring knowledge from a complex teacher model to a smaller, lightweight student model, reducing model size and inference time with minimal accuracy loss. In this paper, a KD-based framework is utilized to design and train both teacher and student models for intrusion detection using the N-BaIoT and CIC-IDS 2023 datasets. The student model achieves comparable performance to the teacher, with accuracies of 99.87% and 98.71% on the utilized datasets. It maintains accurate classification across various attack classes, achieving F1-scores above 0.98, while reducing computational complexity from 263k to 120k trainable parameters, model size from 1.00 MB to 471.67 KB, and inference time from 48 ms to 34 ms. Moreover, SHAP-based explainable AI techniques are employed to interpret both models, demonstrating that the distilled student model retains key feature attributions of the teacher model.
Förderung
- Deanship of Research and Graduate Studies at King Khalid University
- Large Research Project
Zitieren
APA
Umair, M., Khan, M. S., Malwi, W. A., Asiri, F., Nafea, I., Saeed, F., & Ahmad, J. (2025). Knowledge Distillation for Lightweight and Explainable Intrusion Detection in Resource-Constrained Consumer Devices. IEEE Transactions on Consumer Electronics, 71(4), 12157-12165. https://doi.org/10.1109/tce.2025.3601183
Vancouver
Umair M, Khan MS, Malwi WA, Asiri F, Nafea I, Saeed F, et al. Knowledge Distillation for Lightweight and Explainable Intrusion Detection in Resource-Constrained Consumer Devices. IEEE Transactions on Consumer Electronics. 2025;71(4):12157-12165. doi:10.1109/tce.2025.3601183
BibTeX
@article{Umair2025,
author = {Umair, Muhammad and Khan, Muhammad Shahbaz and Malwi, Wajdan Al and Asiri, Fatima and Nafea, Ibtehal and Saeed, Faisal and Ahmad, Jawad},
title = {Knowledge Distillation for Lightweight and Explainable Intrusion Detection in Resource-Constrained Consumer Devices},
journal = {IEEE Transactions on Consumer Electronics},
year = {2025},
volume = {71},
number = {4},
pages = {12157--12165},
doi = {10.1109/tce.2025.3601183}
}
EUVIMED