EUVIMEDEUVIMED entdecken
Crossref

A Suite of Efficient Randomized Algorithms for Streaming Record Linkage

Dimitrios Karapiperis, Christos Tjortjis, Vassilios S. Verykios

IEEE Transactions on Knowledge and Data Engineering · 2024-07 · 36 (7) · 2803-2813

DOI: 10.1109/tkde.2024.3361022 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Knowledge and Data Engineering, 2024-07. Verfasst von Dimitrios Karapiperis und 2 weiteren Autor:innen. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 24 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Organizations leverage massive volumes of information and new types of data to generate unprecedented insights and improve their outcomes. Correctly identifying duplicate records that represent the same entity, such as user, customer, patient and so on, a process commonly known as record linkage, can improve service levels, accelerate sales, or elevate healthcare decision support. Towards this direction, blocking methods are used with the aim to group matching records in the same block using a combination of their attributes as blocking keys. This paper introduces a suite of randomized algorithms specifically crafted for streaming record linkage settings. Using a bounded in-memory data structure, in terms of the number of blocks and positions within each block, our algorithms guarantee that the most frequently accessed and the most recently used blocks remain in main memory and, additionally, the records within a block are renewed on a rolling basis. The operation of our algorithms rely on simple random choices, instead of utilizing cumbersome sorting data structures, which ensure that the probability of inactive blocks and older records to remain in main memory decays in order to free space for more promising blocks and fresher records, respectively. We also introduce an algorithm that performs approximate blocking to tackle the problem of misspellings and typos present in the blocking keys. The experimental evaluation showcases that our proposed algorithms scale efficiently to data streams by providing certain accuracy guarantees.

Zitieren

APA

Karapiperis, D., Tjortjis, C., & Verykios, V. S. (2024). A Suite of Efficient Randomized Algorithms for Streaming Record Linkage. IEEE Transactions on Knowledge and Data Engineering, 36(7), 2803-2813. https://doi.org/10.1109/tkde.2024.3361022

Vancouver

Karapiperis D, Tjortjis C, Verykios VS. A Suite of Efficient Randomized Algorithms for Streaming Record Linkage. IEEE Transactions on Knowledge and Data Engineering. 2024;36(7):2803-2813. doi:10.1109/tkde.2024.3361022

BibTeX
@article{Karapiperis2024,
  author = {Karapiperis, Dimitrios and Tjortjis, Christos and Verykios, Vassilios S.},
  title = {A Suite of Efficient Randomized Algorithms for Streaming Record Linkage},
  journal = {IEEE Transactions on Knowledge and Data Engineering},
  year = {2024},
  volume = {36},
  number = {7},
  pages = {2803--2813},
  doi = {10.1109/tkde.2024.3361022}
}
Kostenlos starten →