EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Efficient outlier detection in numerical and categorical data

Eugênio F. Cabral, Braulio V. Sánchez Vinces, Guilherme D. F. Silva, Jörg Sander, Robson L. F. Cordeiro

Data Mining and Knowledge Discovery · 2025-05 · 39 (3)

DOI: 10.1007/s10618-024-01084-1 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Data Mining and Knowledge Discovery, online erschienen am 07.03.2025. Verfasst von Eugênio F. Cabral und 4 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 43 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Fundação de Amparo à Pesquisa do Estado de São Paulo, Coordenação de Aperfeiçoamento de Pessoal de Nível Superior, Conselho Nacional de Desenvolvimento Científico e Tecnológico.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

How to spot outliers in a large, unlabeled dataset with both numerical and categorical attributes? How to do it in a fast and scalable way? Outlier detection has many applications; it is covered therefore by an extensive literature. The distance-based detectors are the most popular ones. However, they still have two major drawbacks: (a) the intensive neighborhood search that takes hours or even days to complete in large data, and; (b) the inability to process categorical attributes. This paper tackles both problems by presenting HySortOD : a new, fast and scalable detector for numerical and categorical data. Our main focus is the analysis of datasets with many instances, and a low-to-moderate number of attributes. We studied dozens of real, benchmark datasets with up to one million instances ; HySortOD outperformed nine competitors from the state of the art in runtime, being up to six orders of magnitude faster in large data, while maintaining high accuracy. Finally, we also performed an extensive experimental evaluation that confirms the ability of our method to obtain high-quality results from both real and synthetic datasets with categorical attributes.

Förderung

  • Fundação de Amparo à Pesquisa do Estado de São Paulo
  • Coordenação de Aperfeiçoamento de Pessoal de Nível Superior
  • Conselho Nacional de Desenvolvimento Científico e Tecnológico
  • Carnegie Mellon University

Zitieren

APA

Cabral, E. F., Vinces, B. V. S., Silva, G. D. F., Sander, J., & Cordeiro, R. L. F. (2025). Efficient outlier detection in numerical and categorical data. Data Mining and Knowledge Discovery, 39(3). https://doi.org/10.1007/s10618-024-01084-1

Vancouver

Cabral EF, Vinces BVS, Silva GDF, Sander J, Cordeiro RLF. Efficient outlier detection in numerical and categorical data. Data Mining and Knowledge Discovery. 2025;39(3). doi:10.1007/s10618-024-01084-1

BibTeX
@article{Cabral2025,
  author = {Cabral, Eugênio F. and Vinces, Braulio V. Sánchez and Silva, Guilherme D. F. and Sander, Jörg and Cordeiro, Robson L. F.},
  title = {Efficient outlier detection in numerical and categorical data},
  journal = {Data Mining and Knowledge Discovery},
  year = {2025},
  volume = {39},
  number = {3},
  doi = {10.1007/s10618-024-01084-1}
}
Kostenlos starten →