EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

An Explainable Machine Learning Framework for Insider Threat Detection Using Behavioral Feature Engineering

Omar Sedqi Kareem

Dasinya Journal for Engineering and Informatics · 13.11.2026 · 2 (4)

DOI: 10.65542/djei.v2i4.102 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Dasinya Journal for Engineering and Informatics, online erschienen am 13.11.2026. Verfasst von Omar Sedqi Kareem. Die Arbeit nennt 23 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Insider threat detection remains one of the most challenging problems in cybersecurity because malicious activities are often difficult to distinguish from legitimate user behavior. Many existing machine learning approaches rely on limited behavioral representations, high-dimensional feature spaces, and black-box models with limited interpretability, which constrains their practical utility in security operations. This paper proposes an explainable machine learning framework for insider threat detection based on behavioral feature engineering. The framework constructs daily user-level behavioral profiles from heterogeneous sources in the Computer Emergency Response Team (CERT) Insider Threat Dataset (Release 4.2), including logon, email, web browsing, file access, Universal Serial Bus (USB) device usage, and psychometric records. A Genetic Algorithm (GA) reduces the engineered feature space from 53 to 35 features while retaining comparable predictive performance. A LightGBM classifier is then optimized through Bayesian hyperparameter tuning with Optuna, followed by decision threshold optimization to balance precision and recall. SHapley Additive exPlanations (SHAP) provide global and local explanations, enabling security analysts to examine the factors behind individual decisions. On the independent test set, the framework achieved 99.79% accuracy, 83.78% precision, 60.78% recall, 70.45% F1-score, 97.92% ROC-AUC, 71.14% PR-AUC, 80.37% balanced accuracy, and 71.27% MCC. The gap between high accuracy and lower recall and F1-score reflects the severe class imbalance of the dataset. These findings demonstrate the feasibility of integrating behavioral feature engineering, feature selection, model optimization, and explainable AI within a unified framework.

Zitieren

APA

Kareem, O. S. (2026). An Explainable Machine Learning Framework for Insider Threat Detection Using Behavioral Feature Engineering. Dasinya Journal for Engineering and Informatics, 2(4). https://doi.org/10.65542/djei.v2i4.102

Vancouver

Kareem OS. An Explainable Machine Learning Framework for Insider Threat Detection Using Behavioral Feature Engineering. Dasinya Journal for Engineering and Informatics. 2026;2(4). doi:10.65542/djei.v2i4.102

BibTeX
@article{Kareem2026,
  author = {Kareem, Omar Sedqi},
  title = {An Explainable Machine Learning Framework for Insider Threat Detection Using Behavioral Feature Engineering},
  journal = {Dasinya Journal for Engineering and Informatics},
  year = {2026},
  volume = {2},
  number = {4},
  doi = {10.65542/djei.v2i4.102}
}
Kostenlos starten →