Towards a Standard Benchmarking Framework for Domain Adaptation in Intelligent Fault Diagnosis
IEEE Access · 2025 · 13 · 24426-24453
DOI: 10.1109/access.2025.3537817 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Access, 2025. Verfasst von Mohammed M. Farag. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 64 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: Deanship of Scientific Research, Vice Presidency for Graduate Studies and Scientific Research, King Faisal University, Saudi Arabia.
Abstract (Originalsprache)
Domain shift is a major problem facing contemporary data-based intelligent fault diagnosis (IFD) solutions. While domain adaptation (DA) methods have been proposed to address this issue, standardizing DA benchmarks has not received much attention. Existing studies often use ad-hoc evaluation methods with inconsistent dataset partitioning, labeling, and evaluation criteria. We propose an integrated benchmarking framework to bridge the gap between DA development and evaluation research. Our framework incorporates domain shift key factors such as operating conditions (OCs) and fault levels (FLs) into dataset partitioning, labeling, and evaluation phases. The fault dataset is split into distinct subsets using FLs and OCs as partitioning parameters, while maintaining the original diagnostic classification labels. The DA method is comprehensively evaluated under controlled conditions using permuted subset pairs of the partitioned dataset. The framework is applied to two popular datasets – the Case Western Reserve University (CWRU) and Paderborn University (PU) bearing fault datasets. We demonstrate the framework’s capabilities and application mechanisms using a CNN classifier and an adversarial DA algorithm. Benchmarking results reveal significant accuracy drops from 99% to 36% and 45% with variances of 15% and 20% for the CWRU and PU datasets, respectively, under controlled domain shift conditions. The proposed framework establishes a foundation for standardizing IFD DA benchmarks, bridging the gap between development and evaluation research.
Förderung
- Deanship of Scientific Research, Vice Presidency for Graduate Studies and Scientific Research, King Faisal University, Saudi Arabia
Zitieren
APA
Farag, M. M. (2025). Towards a Standard Benchmarking Framework for Domain Adaptation in Intelligent Fault Diagnosis. IEEE Access, 13, 24426-24453. https://doi.org/10.1109/access.2025.3537817
Vancouver
Farag MM. Towards a Standard Benchmarking Framework for Domain Adaptation in Intelligent Fault Diagnosis. IEEE Access. 2025;13:24426-24453. doi:10.1109/access.2025.3537817
BibTeX
@article{Farag2025,
author = {Farag, Mohammed M.},
title = {Towards a Standard Benchmarking Framework for Domain Adaptation in Intelligent Fault Diagnosis},
journal = {IEEE Access},
year = {2025},
volume = {13},
pages = {24426--24453},
doi = {10.1109/access.2025.3537817}
}
EUVIMED