Evaluating the accuracy and speed of eight deduplication tools: A comparative study
Research Synthesis Methods · 2026-11 · 17 (6) · 1144-1157
DOI: 10.1017/rsm.2026.10100 ↗Kurz gefasst
Fachartikel in der Zeitschrift Research Synthesis Methods, online erschienen am 17.06.2026. Verfasst von Sarah Bateup und 7 weiteren Autor:innen. Beteiligte Einrichtung: Library Services, https://ror.org/006jxzx88Bond University, Gold Coast, Australia. Die Arbeit nennt 20 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
A key task in conducting systematic reviews is deduplicating the results from database searching. Deduplication using reference management software can be time-consuming and prone to error, while automated tools can be expensive and lack transparency. To support review teams, we evaluated eight deduplication tools: (1) The Automated Systematic Search Deduplicator (ASySD); (2) Covidence; (3) Deduklick; (4) EPPI-Reviewer; (5) PICO Portal; (6) Rayyan; (7) The Systematic Review Accelerator (SRA) Deduplicator: Focused; (8) The SRA Deduplicator: Relaxed. Five randomly selected Cochrane reviews had their searches rerun to create five gold standard sets. We compared the gold standard sets to the outputs of the eight deduplication tools and evaluated the results for: (1) unique records removed; (2) duplicate records retained; (3) time taken to deduplicate. Summed across all five reviews, the unique records removed in error ranged from 2 to 22. The three best tools were: (1) Rayyan; (2) Covidence; (3) SRA Deduplicator: Focused. The duplicate records retained in error ranged from 34 to 280, the three best tools were: (1) ASySD; (2) Rayyan; (3) EPPI-Reviewer. The time taken to deduplicate ranged from one minute to 20 hours and 34 minutes, the three fastest tools were: (1) SRA Deduplicator: Relaxed; (2) Deduklick; (3) Covidence. No tool performed so poorly that we don’t recommend using it. But, as all the tools had strengths and weaknesses, some are expensive while others require large amounts of manual checking time, we recommend review teams compare the tools across all three outcomes and choose the tool that best suits their needs.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Library Services, https://ror.org/006jxzx88Bond University, Gold Coast, Australia.
- Centre for Reviews and Dissemination, https://ror.org/010pgs956University of York, UK.
- https://ror.org/04507cg26Swedish Agency for Health Technology Assessment and Assessment of Social Services, Sweden.
- EPPI Centre, UCL Social Research Institute, https://ror.org/02jx3x895University College London, UK.
- Department of Ophthalmology, School of Medicine, https://ror.org/03wmf1y16University of Colorado, Anschutz Medical Campus, USA.
- Institute for Evidence-Based Healthcare, https://ror.org/006jxzx88Bond University, Gold Coast, Australia.
ORCID-Profile: Sarah Bateup, Klas Moberg, Kaitlyn Hair, Emmy Peterson, Justin Clark
Zitieren
APA
Bateup, S., Fulbright, H., Moberg, K., Hair, K., Peterson, E., Stansfield, C. M., Qureshi, R., & Clark, J. (2026). Evaluating the accuracy and speed of eight deduplication tools: A comparative study. Research Synthesis Methods, 17(6), 1144-1157. https://doi.org/10.1017/rsm.2026.10100
Vancouver
Bateup S, Fulbright H, Moberg K, Hair K, Peterson E, Stansfield CM, et al. Evaluating the accuracy and speed of eight deduplication tools: A comparative study. Research Synthesis Methods. 2026;17(6):1144-1157. doi:10.1017/rsm.2026.10100
BibTeX
@article{Bateup2026,
author = {Bateup, Sarah and Fulbright, Helen and Moberg, Klas and Hair, Kaitlyn and Peterson, Emmy and Stansfield, Claire M and Qureshi, Riaz and Clark, Justin},
title = {Evaluating the accuracy and speed of eight deduplication tools: A comparative study},
journal = {Research Synthesis Methods},
year = {2026},
volume = {17},
number = {6},
pages = {1144--1157},
doi = {10.1017/rsm.2026.10100}
}
EUVIMED