Cross-Dataset Intrusion Detection under Benchmark Shift: Directed Transfer, Probability Calibration, and Alert Burden
Interdisciplinary Journal of AI, Machine Learning & Data Science · 06.11.2026 · 1 (3) · e014
DOI: 10.66261/vx9swp16 ↗Kurz gefasst
Fachartikel in der Zeitschrift Interdisciplinary Journal of AI, Machine Learning & Data Science, online erschienen am 06.11.2026. Verfasst von Priyanga R. Die Arbeit nennt 26 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Machine-learning intrusion detectors commonly report strong performance within one benchmark, but deployment requires transport across traffic environments and realistic target prevalence. This study used three public harmonized NetFlow datasets: NF-UNSW-NB15, NF-ToN-IoT, and NF-BoT-IoT. Their archive attack prevalences were 4.46%, 80.40%, and 97.69%, whereas the balanced analytical samples had 40.23%, 50.00%, and 86.66%. Across the original crossed experiment, mean within-domain AUROC was 0.9773 versus 0.5445 across domains. Removing endpoint-oriented fields reduced uncalibrated cross-domain AUROC from 0.5881 to 0.4990, and source Platt scaling worsened target Brier loss. In a separate repeated evaluation using three uniform 100,000-flow samples at each target’s natural archive prevalence, full-flow models achieved mean AUROC 0.5880, AUPRC 0.6406, F1 0.4348, and Brier loss 0.3398. A threshold fixed at the source-negative 99.5th percentile nevertheless alerted on 36.2% of target flows. Endpoint reduction produced near-chance AUROC (0.4996) and lower F1 (0.3733). High within-benchmark scores therefore did not establish portable ranking, probability quality, or manageable alert rates.
Zitieren
APA
R, P. (2026). Cross-Dataset Intrusion Detection under Benchmark Shift: Directed Transfer, Probability Calibration, and Alert Burden. Interdisciplinary Journal of AI, Machine Learning & Data Science, 1(3), e014. https://doi.org/10.66261/vx9swp16
Vancouver
R P. Cross-Dataset Intrusion Detection under Benchmark Shift: Directed Transfer, Probability Calibration, and Alert Burden. Interdisciplinary Journal of AI, Machine Learning & Data Science. 2026;1(3):e014. doi:10.66261/vx9swp16
BibTeX
@article{R2026,
author = {R, Priyanga},
title = {Cross-Dataset Intrusion Detection under Benchmark Shift: Directed Transfer, Probability Calibration, and Alert Burden},
journal = {Interdisciplinary Journal of AI, Machine Learning & Data Science},
year = {2026},
volume = {1},
number = {3},
pages = {e014},
doi = {10.66261/vx9swp16}
}
EUVIMED