An Ensemble Outlier Detection Method Based on Information Entropy-Weighted Subspaces for High-Dimensional Data
Entropy · 09.08.2023 · 25 (8) · 1185
DOI: 10.3390/e25081185 ↗Kurz gefasst
Fachartikel in der Zeitschrift Entropy, online erschienen am 09.08.2023. Verfasst von Zihao Li und 1 weiteren Autor:innen. Beteiligte Einrichtung: School of Computing, Xi'an Shiyou University, Xi'an 710065, China. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Shaanxi Key Laboratory for Network Computing and Security Technology.
Abstract (Originalsprache)
Outlier detection is an important task in the field of data mining and a highly active area of research in machine learning. In industrial automation, datasets are often high-dimensional, meaning an effort to study all dimensions directly leads to data sparsity, thus causing outliers to be masked by noise effects in high-dimensional spaces. The “curse of dimensionality” phenomenon renders many conventional outlier detection methods ineffective. This paper proposes a new outlier detection algorithm called EOEH (Ensemble Outlier Detection Method Based on Information Entropy-Weighted Subspaces for High-Dimensional Data). First, random secondary subsampling is performed on the data, and detectors are run on various small-scale sub-samples to provide diverse detection results. Results are then aggregated to reduce the global variance and enhance the robustness of the algorithm. Subsequently, information entropy is utilized to construct a dimension-space weighting method that can discern the influential factors within different dimensional spaces. This method generates weighted subspaces and dimensions for data objects, reducing the impact of noise created by high-dimensional data and improving high-dimensional data detection performance. Finally, this study offers a design for a new high-precision local outlier factor (HPLOF) detector that amplifies the differentiation between normal and outlier data, thereby improving the detection performance of the algorithm. The feasibility of this algorithm is validated through experiments that used both simulated and UCI datasets. In comparison to popular outlier detection algorithms, our algorithm demonstrates a superior detection performance and runtime efficiency. Compared with the current popular, common algorithms, the EOEH algorithm improves the detection performance by 6% on average. In terms of running time for high-dimensional data, EOEH is 20% faster than the current popular algorithms.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Computing, Xi'an Shiyou University, Xi'an 710065, China.
ORCID-Profile: Zihao Li, Liumei Zhang
Förderung
- Shaanxi Key Laboratory for Network Computing and Security Technology
Zitieren
APA
Li, Z., & Zhang, L. (2023). An Ensemble Outlier Detection Method Based on Information Entropy-Weighted Subspaces for High-Dimensional Data. Entropy, 25(8), 1185. https://doi.org/10.3390/e25081185
Vancouver
Li Z, Zhang L. An Ensemble Outlier Detection Method Based on Information Entropy-Weighted Subspaces for High-Dimensional Data. Entropy. 2023;25(8):1185. doi:10.3390/e25081185
BibTeX
@article{Li2023,
author = {Li, Zihao and Zhang, Liumei},
title = {An Ensemble Outlier Detection Method Based on Information Entropy-Weighted Subspaces for High-Dimensional Data},
journal = {Entropy},
year = {2023},
volume = {25},
number = {8},
pages = {1185},
doi = {10.3390/e25081185}
}
EUVIMED