EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Lightweight Knowledge Distillation-Based Transfer Learning Framework for Rolling Bearing Fault Diagnosis

Ruijia Lu, Shuzhi Liu iD, Zisu Gong, Chengcheng Xu, Zonghe Ma, Yiqi Zhong, Baojian Li

Sensors · 08.03.2024 · 24 (6) · 1758

DOI: 10.3390/s24061758 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 08.03.2024. Verfasst von Ruijia Lu und 6 weiteren Autor:innen. Beteiligte Einrichtung: School of Physics and Electronic Engineering, Qilu Normal University, Jinan 250200, China. Die Arbeit wurde bisher 33-mal zitiert (Crossref) und nennt 32 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Natural Science Foundation Youth Foundation of Shandong Province of China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Compared to fault diagnosis across operating conditions, the differences in data distribution between devices are more pronounced and better aligned with practical application needs. However, current research on transfer learning inadequately addresses fault diagnosis issues across devices. To better balance the relationship between computational resources and diagnostic accuracy, a knowledge distillation-based lightweight transfer learning framework for rolling bearing diagnosis is proposed in this study. Specifically, a deep teacher–student model based on variable-scale residual networks is constructed to learn domain-invariant features relevant to fault classification within both the source and target domain data. Subsequently, a knowledge distillation framework incorporating a temperature factor is established to transfer fault features learned by the large teacher model in the source domain to the smaller student model, thereby reducing computational and parameter overhead. Finally, a multi-kernel domain adaptation method is employed to capture the feature probability distribution distance of fault characteristics between the source and target domains in Reproducing Kernel Hilbert Space (RKHS), and domain-invariant features are learned by minimizing the distribution distance between them. The effectiveness and applicability of the proposed method in situations of incomplete data across device types were validated through two engineering cases, spanning device models and transitioning from laboratory equipment to real-world operational devices.

Schlagwörter

Stichwörter der Autor:innen

knowledge distillationlightweightmulti-kernel domain adaptation approachvariational-scale residual networks

Autor:innen und Institutionen

  • School of Physics and Electronic Engineering, Qilu Normal University, Jinan 250200, China.

ORCID-Profile: Shuzhi Liu

Förderung

  • Natural Science Foundation Youth Foundation of Shandong Province of China

Zitieren

APA

Lu, R., Liu, S., Gong, Z., Xu, C., Ma, Z., Zhong, Y., & Li, B. (2024). Lightweight Knowledge Distillation-Based Transfer Learning Framework for Rolling Bearing Fault Diagnosis. Sensors, 24(6), 1758. https://doi.org/10.3390/s24061758

Vancouver

Lu R, Liu S, Gong Z, Xu C, Ma Z, Zhong Y, et al. Lightweight Knowledge Distillation-Based Transfer Learning Framework for Rolling Bearing Fault Diagnosis. Sensors. 2024;24(6):1758. doi:10.3390/s24061758

BibTeX
@article{Lu2024,
  author = {Lu, Ruijia and Liu, Shuzhi and Gong, Zisu and Xu, Chengcheng and Ma, Zonghe and Zhong, Yiqi and Li, Baojian},
  title = {Lightweight Knowledge Distillation-Based Transfer Learning Framework for Rolling Bearing Fault Diagnosis},
  journal = {Sensors},
  year = {2024},
  volume = {24},
  number = {6},
  pages = {1758},
  doi = {10.3390/s24061758}
}
Kostenlos starten →