EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

The Effect of Dataset Imbalance on the Performance of SCADA Intrusion Detection Systems

Asaad Balla iD, Mohamed Hadi Habaebi iD, Elfatih A A Elsheikh iD, Md Rafiqul Islam, F M Suliman

Sensors · 09.01.2023 · 23 (2) · 758

DOI: 10.3390/s23020758 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 09.01.2023. Verfasst von Asaad Balla und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electrical and Computer Engineering, International Islamic University Malaysia, Kuala Lumpur 53100, Malaysia. Die Arbeit wurde bisher 70-mal zitiert (Crossref) und nennt 16 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: King Khalid University.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Integrating IoT devices in SCADA systems has provided efficient and improved data collection and transmission technologies. This enhancement comes with significant security challenges, exposing traditionally isolated systems to the public internet. Effective and highly reliable security devices, such as intrusion detection system (IDSs) and intrusion prevention systems (IPS), are critical. Countless studies used deep learning algorithms to design an efficient IDS; however, the fundamental issue of imbalanced datasets was not fully addressed. In our research, we examined the impact of data imbalance on developing an effective SCADA-based IDS. To investigate the impact of various data balancing techniques, we chose two unbalanced datasets, the Morris power dataset, and CICIDS2017 dataset, including random sampling, one-sided selection (OSS), near-miss, SMOTE, and ADASYN. For binary classification, convolutional neural networks were coupled with long short-term memory (CNN-LSTM). The system’s effectiveness was determined by the confusion matrix, which includes evaluation metrics, such as accuracy, precision, detection rate, and F1-score. Four experiments on the two datasets demonstrate the impact of the data imbalance. This research aims to help security researchers in understanding imbalanced datasets and their impact on DL SCADA-IDS.

Schlagwörter

Stichwörter der Autor:innen

ICSIDSSCADAcyber securityimbalanced datasets

Autor:innen und Institutionen

  • Department of Electrical and Computer Engineering, International Islamic University Malaysia, Kuala Lumpur 53100, Malaysia.
  • Department of Electrical Engineering, College of Engineering, King Khalid University, Abha 61421, Saudi Arabia.

ORCID-Profile: Asaad Balla, Mohamed Hadi Habaebi, Elfatih A A Elsheikh

Förderung

  • King Khalid University

Zitieren

APA

Balla, A., Habaebi, M. H., Elsheikh, E. A. A., Islam, M. R., & Suliman, F. M. (2023). The Effect of Dataset Imbalance on the Performance of SCADA Intrusion Detection Systems. Sensors, 23(2), 758. https://doi.org/10.3390/s23020758

Vancouver

Balla A, Habaebi MH, Elsheikh EAA, Islam MR, Suliman FM. The Effect of Dataset Imbalance on the Performance of SCADA Intrusion Detection Systems. Sensors. 2023;23(2):758. doi:10.3390/s23020758

BibTeX
@article{Balla2023,
  author = {Balla, Asaad and Habaebi, Mohamed Hadi and Elsheikh, Elfatih A A and Islam, Md Rafiqul and Suliman, F M},
  title = {The Effect of Dataset Imbalance on the Performance of SCADA Intrusion Detection Systems},
  journal = {Sensors},
  year = {2023},
  volume = {23},
  number = {2},
  pages = {758},
  doi = {10.3390/s23020758}
}
Kostenlos starten →