The Effect of Dataset Imbalance on the Performance of SCADA Intrusion Detection Systems
Sensors · 09.01.2023 · 23 (2) · 758
DOI: 10.3390/s23020758 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 09.01.2023. Verfasst von Asaad Balla und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electrical and Computer Engineering, International Islamic University Malaysia, Kuala Lumpur 53100, Malaysia. Die Arbeit wurde bisher 70-mal zitiert (Crossref) und nennt 16 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: King Khalid University.
Abstract (Originalsprache)
Integrating IoT devices in SCADA systems has provided efficient and improved data collection and transmission technologies. This enhancement comes with significant security challenges, exposing traditionally isolated systems to the public internet. Effective and highly reliable security devices, such as intrusion detection system (IDSs) and intrusion prevention systems (IPS), are critical. Countless studies used deep learning algorithms to design an efficient IDS; however, the fundamental issue of imbalanced datasets was not fully addressed. In our research, we examined the impact of data imbalance on developing an effective SCADA-based IDS. To investigate the impact of various data balancing techniques, we chose two unbalanced datasets, the Morris power dataset, and CICIDS2017 dataset, including random sampling, one-sided selection (OSS), near-miss, SMOTE, and ADASYN. For binary classification, convolutional neural networks were coupled with long short-term memory (CNN-LSTM). The system’s effectiveness was determined by the confusion matrix, which includes evaluation metrics, such as accuracy, precision, detection rate, and F1-score. Four experiments on the two datasets demonstrate the impact of the data imbalance. This research aims to help security researchers in understanding imbalanced datasets and their impact on DL SCADA-IDS.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Electrical and Computer Engineering, International Islamic University Malaysia, Kuala Lumpur 53100, Malaysia.
- Department of Electrical Engineering, College of Engineering, King Khalid University, Abha 61421, Saudi Arabia.
ORCID-Profile: Asaad Balla, Mohamed Hadi Habaebi, Elfatih A A Elsheikh
Förderung
- King Khalid University
Zitieren
APA
Balla, A., Habaebi, M. H., Elsheikh, E. A. A., Islam, M. R., & Suliman, F. M. (2023). The Effect of Dataset Imbalance on the Performance of SCADA Intrusion Detection Systems. Sensors, 23(2), 758. https://doi.org/10.3390/s23020758
Vancouver
Balla A, Habaebi MH, Elsheikh EAA, Islam MR, Suliman FM. The Effect of Dataset Imbalance on the Performance of SCADA Intrusion Detection Systems. Sensors. 2023;23(2):758. doi:10.3390/s23020758
BibTeX
@article{Balla2023,
author = {Balla, Asaad and Habaebi, Mohamed Hadi and Elsheikh, Elfatih A A and Islam, Md Rafiqul and Suliman, F M},
title = {The Effect of Dataset Imbalance on the Performance of SCADA Intrusion Detection Systems},
journal = {Sensors},
year = {2023},
volume = {23},
number = {2},
pages = {758},
doi = {10.3390/s23020758}
}
EUVIMED