Outlier Detection in Bayesian Neural Networks
Nordic Machine Intelligence · 2025
DOI: 10.5617/nmi.11406 ↗Kurz gefasst
Fachartikel in der Zeitschrift Nordic Machine Intelligence, 2025. Verfasst von Herman Ellingsen und 3 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Describing uncertainty is one of the major issues in modern deep learning. Artificial Intelligence models could be used with greater confidence by having solid methods for identifying and quantifying uncertainty. This article proposes two alternative methods for outlier detection in Bayesian Neural Networks used for classification tasks. This is done by looking for unusual pre-activation neuron values in the last layer of a Bayesian Neural Network. The proposed methods are compared to a baseline method for outlier detection, Predictive Entropy, on three datasets: a simulated dataset, the MNIST dataset, and the Breast Cancer Wisconsin dataset. In addition, we introduce a method for separating In-Between and Out-Of-Distribution outliers. The results indicate that the proposed methods' performance depends on the dataset type. In the case of a simple simulated dataset, we see that the proposed methods outperform the baseline method. The proposed method also outperforms the baseline method on the Breast Cancer Wisconsin dataset. However, when tested on the MNIST image dataset, we observed that the baseline is better than the proposed method. As expected, for all three datasets, an OR-combination of the two methods gives slightly better POWER score than the two methods separately, but this comes at the price of also obtaining a higher FDR score.
Zitieren
APA
Ellingsen, H., Hubin, A., Remonato, F., & Sæbø, S. (2025). Outlier Detection in Bayesian Neural Networks. Nordic Machine Intelligence. https://doi.org/10.5617/nmi.11406
Vancouver
Ellingsen H, Hubin A, Remonato F, Sæbø S. Outlier Detection in Bayesian Neural Networks. Nordic Machine Intelligence. 2025. doi:10.5617/nmi.11406
BibTeX
@article{Ellingsen2025,
author = {Ellingsen, Herman and Hubin, Aliaksandr and Remonato, Filippo and Sæbø, Solve},
title = {Outlier Detection in Bayesian Neural Networks},
journal = {Nordic Machine Intelligence},
year = {2025},
doi = {10.5617/nmi.11406}
}
EUVIMED