Fast-ER: GPU-Accelerated Record Linkage and Deduplication in Python
Journal of Open Research Software · 21.04.2026 · 14
DOI: 10.5334/jors.556 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Open Research Software, erschienen am 21.04.2026. Verfasst von Jacob Morrier und 2 weiteren Autor:innen. Die Arbeit nennt 7 Literaturangaben.
Abstract (Originalsprache)
Fast-ER is a Python package for GPU-accelerated record linkage and deduplication. These tasks involve computing string similarity metrics for all pairs of values within or between datasets. While these individual calculations are simple, the number of comparisons grows quadratically with dataset size, making record linkage and deduplication prohibitively expensive even for moderately sized datasets. Fast-ER addresses this challenge by harnessing the computational power of CUDA-enabled graphics processing units (GPUs) to accelerate string similarity metrics calculations. Developed in Python, our software library relies heavily on CuPy, an open-source library for array-based numerical computations on GPUs [1]. Fast-ER is readily available on GitHub (https://github.com/jacobmorrier/fast-er) and the Python Package Index (fast-er-link). By enabling fast and efficient linking and deduplication of datasets without consistent identifiers, Fast-ER has wide-ranging applications across fields such as social and health sciences.
Zitieren
APA
Morrier, J., Kishore, S., & Alvarez, R. M. (2026). Fast-ER: GPU-Accelerated Record Linkage and Deduplication in Python. Journal of Open Research Software, 14. https://doi.org/10.5334/jors.556
Vancouver
Morrier J, Kishore S, Alvarez RM. Fast-ER: GPU-Accelerated Record Linkage and Deduplication in Python. Journal of Open Research Software. 2026;14. doi:10.5334/jors.556
BibTeX
@article{Morrier2026,
author = {Morrier, Jacob and Kishore, Sulekha and Alvarez, R. Michael},
title = {Fast-ER: GPU-Accelerated Record Linkage and Deduplication in Python},
journal = {Journal of Open Research Software},
year = {2026},
volume = {14},
doi = {10.5334/jors.556}
}
EUVIMED