Extending string similarity join to tolerant fuzzy token matching
ACM Transactions on Database Systems · 2014-01 · 39 (1) · 1-45
DOI: 10.1145/2535628 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Database Systems, online erschienen am 06.01.2014. Verfasst von Jiannan Wang und 2 weiteren Autor:innen. Die Arbeit wurde bisher 40-mal zitiert (Crossref) und nennt 41 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Media Development Authority - Singapore, Tsinghua University.
Abstract (Originalsprache)
String similarity join that finds similar string pairs between two string sets is an essential operation in many applications and has attracted significant attention recently in the database community. A significant challenge in similarity join is to implement an effective fuzzy match operation to find all similar string pairs which may not match exactly. In this article, we propose a new similarity function, called fuzzy-token-matching-based similarity which extends token-based similarity functions (e.g., jaccard similarity and cosine similarity) by allowing fuzzy match between two tokens. We study the problem of similarity join using this new similarity function and present a signature-based method to address this problem. We propose new signature schemes and develop effective pruning techniques to improve the performance. We also extend our techniques to support weighted tokens. Experimental results show that our method achieves high efficiency and result quality and significantly outperforms state-of-the-art approaches.
Förderung
- National Natural Science Foundation of China
- Media Development Authority - Singapore
- Tsinghua University
- Tsinghua-Tencent Joint Laboratory for Internet Innovation Technology
- Ministry of Science and Technology of the People's Republic of China
Zitieren
APA
Wang, J., Li, G., & Feng, J. (2014). Extending string similarity join to tolerant fuzzy token matching. ACM Transactions on Database Systems, 39(1), 1-45. https://doi.org/10.1145/2535628
Vancouver
Wang J, Li G, Feng J. Extending string similarity join to tolerant fuzzy token matching. ACM Transactions on Database Systems. 2014;39(1):1-45. doi:10.1145/2535628
BibTeX
@article{Wang2014,
author = {Wang, Jiannan and Li, Guoliang and Feng, Jianhua},
title = {Extending string similarity join to tolerant fuzzy token matching},
journal = {ACM Transactions on Database Systems},
year = {2014},
volume = {39},
number = {1},
pages = {1--45},
doi = {10.1145/2535628}
}
EUVIMED