EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Outlier Detection with Reinforcement Learning for Costly to Verify Data

Michiel Nijhuis, Iman van Lelyveld iD

Entropy · 25.05.2023 · 25 (6) · 842

DOI: 10.3390/e25060842 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Entropy, online erschienen am 25.05.2023. Verfasst von Michiel Nijhuis und 1 weiteren Autor:innen. Beteiligte Einrichtung: De Nederlandsche Bank, 1000 AB Amsterdam, The Netherlands. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Outliers are often present in data and many algorithms exist to find these outliers. Often we can verify these outliers to determine whether they are data errors or not. Unfortunately, checking such points is time-consuming and the underlying issues leading to the data error can change over time. An outlier detection approach should therefore be able to optimally use the knowledge gained from the verification of the ground truth and adjust accordingly. With advances in machine learning, this can be achieved by applying reinforcement learning on a statistical outlier detection approach. The approach uses an ensemble of proven outlier detection methods in combination with a reinforcement learning approach to tune the coefficients of the ensemble with every additional bit of data. The performance and the applicability of the reinforcement learning outlier detection approach are illustrated using granular data reported by Dutch insurers and pension funds under the Solvency II and FTK frameworks. The application shows that outliers can be identified by the ensemble learner. Moreover, applying the reinforcement learner on top of the ensemble model can further improve the results by optimising the coefficients of the ensemble learner.

Schlagwörter

Stichwörter der Autor:innen

algorithm designanomaly detectionoutlier detectionoutlier ensemblesreinforcement learning

Autor:innen und Institutionen

  • De Nederlandsche Bank, 1000 AB Amsterdam, The Netherlands.
  • Department of Finance, VU Amsterdam, 1081 HV Amsterdam, The Netherlands.

ORCID-Profile: Iman van Lelyveld

Zitieren

APA

Nijhuis, M., & van Lelyveld, I. (2023). Outlier Detection with Reinforcement Learning for Costly to Verify Data. Entropy, 25(6), 842. https://doi.org/10.3390/e25060842

Vancouver

Nijhuis M, van Lelyveld I. Outlier Detection with Reinforcement Learning for Costly to Verify Data. Entropy. 2023;25(6):842. doi:10.3390/e25060842

BibTeX
@article{Nijhuis2023,
  author = {Nijhuis, Michiel and van Lelyveld, Iman},
  title = {Outlier Detection with Reinforcement Learning for Costly to Verify Data},
  journal = {Entropy},
  year = {2023},
  volume = {25},
  number = {6},
  pages = {842},
  doi = {10.3390/e25060842}
}
Kostenlos starten →