Record Fusion via Inference and Data Augmentation
ACM / IMS Journal of Data Science · 2024
DOI: 10.1145/3593579 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM / IMS Journal of Data Science, 2024. Verfasst von Alireza Heidari und 3 weiteren Autor:innen. Die Arbeit nennt 45 Literaturangaben.
Abstract (Originalsprache)
We introduce a learning framework for the problem of unifying conflicting data in multiple records referring to the same entity—we call this problem “record fusion.” Record fusion generalizes two known problems: “data fusion” and “golden record.” Our approach expresses record fusion as a learning problem over probabilistic models. In contrast to prior approaches, our method achieves high performance with or without the records source information and outperforms state-of-the-art baselines. Furthermore, we show how our learned fusion model can solve the problem of scarcity of training data. On multiple datasets, we show that our framework fuses records with an average precision of ∼98% when source information is available and ∼94% without source information across a diverse array of datasets. We compare our approach to a comprehensive collection of data fusion and entity consolidation methods, ranging from source information–related methods to approaches that do not need any source information. We show that our approach can achieve an average improvement of ∼20/∼45 precision points with/without source information. Our data augmentation method improves previous approaches an average of ∼10 precision points.
Zitieren
APA
Heidari, A., Michalopoulos, G., Ilyas, I. F., & Rekatsinas, T. (2024). Record Fusion via Inference and Data Augmentation. ACM / IMS Journal of Data Science. https://doi.org/10.1145/3593579
Vancouver
Heidari A, Michalopoulos G, Ilyas IF, Rekatsinas T. Record Fusion via Inference and Data Augmentation. ACM / IMS Journal of Data Science. 2024. doi:10.1145/3593579
BibTeX
@article{Heidari2024,
author = {Heidari, Alireza and Michalopoulos, George and Ilyas, Ihab F. and Rekatsinas, Theodoros},
title = {Record Fusion via Inference and Data Augmentation},
journal = {ACM / IMS Journal of Data Science},
year = {2024},
doi = {10.1145/3593579}
}
EUVIMED