EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Evaluating the accuracy and speed of eight deduplication tools: A comparative study

Sarah Bateup iD, Helen Fulbright, Klas Moberg iD, Kaitlyn Hair iD, Emmy Peterson iD, Claire M Stansfield, Riaz Qureshi, Justin Clark iD

Research Synthesis Methods · 2026-11 · 17 (6) · 1144-1157

DOI: 10.1017/rsm.2026.10100 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Research Synthesis Methods, online erschienen am 17.06.2026. Verfasst von Sarah Bateup und 7 weiteren Autor:innen. Beteiligte Einrichtung: Library Services, https://ror.org/006jxzx88Bond University, Gold Coast, Australia. Die Arbeit nennt 20 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

A key task in conducting systematic reviews is deduplicating the results from database searching. Deduplication using reference management software can be time-consuming and prone to error, while automated tools can be expensive and lack transparency. To support review teams, we evaluated eight deduplication tools: (1) The Automated Systematic Search Deduplicator (ASySD); (2) Covidence; (3) Deduklick; (4) EPPI-Reviewer; (5) PICO Portal; (6) Rayyan; (7) The Systematic Review Accelerator (SRA) Deduplicator: Focused; (8) The SRA Deduplicator: Relaxed. Five randomly selected Cochrane reviews had their searches rerun to create five gold standard sets. We compared the gold standard sets to the outputs of the eight deduplication tools and evaluated the results for: (1) unique records removed; (2) duplicate records retained; (3) time taken to deduplicate. Summed across all five reviews, the unique records removed in error ranged from 2 to 22. The three best tools were: (1) Rayyan; (2) Covidence; (3) SRA Deduplicator: Focused. The duplicate records retained in error ranged from 34 to 280, the three best tools were: (1) ASySD; (2) Rayyan; (3) EPPI-Reviewer. The time taken to deduplicate ranged from one minute to 20 hours and 34 minutes, the three fastest tools were: (1) SRA Deduplicator: Relaxed; (2) Deduklick; (3) Covidence. No tool performed so poorly that we don’t recommend using it. But, as all the tools had strengths and weaknesses, some are expensive while others require large amounts of manual checking time, we recommend review teams compare the tools across all three outcomes and choose the tool that best suits their needs.

Schlagwörter

Stichwörter der Autor:innen

automationdeduplicationduplicate referencesevidence synthesissystematic review softwaresystematic reviews

Autor:innen und Institutionen

  • Library Services, https://ror.org/006jxzx88Bond University, Gold Coast, Australia.
  • Centre for Reviews and Dissemination, https://ror.org/010pgs956University of York, UK.
  • https://ror.org/04507cg26Swedish Agency for Health Technology Assessment and Assessment of Social Services, Sweden.
  • EPPI Centre, UCL Social Research Institute, https://ror.org/02jx3x895University College London, UK.
  • Department of Ophthalmology, School of Medicine, https://ror.org/03wmf1y16University of Colorado, Anschutz Medical Campus, USA.
  • Institute for Evidence-Based Healthcare, https://ror.org/006jxzx88Bond University, Gold Coast, Australia.

ORCID-Profile: Sarah Bateup, Klas Moberg, Kaitlyn Hair, Emmy Peterson, Justin Clark

Zitieren

APA

Bateup, S., Fulbright, H., Moberg, K., Hair, K., Peterson, E., Stansfield, C. M., Qureshi, R., & Clark, J. (2026). Evaluating the accuracy and speed of eight deduplication tools: A comparative study. Research Synthesis Methods, 17(6), 1144-1157. https://doi.org/10.1017/rsm.2026.10100

Vancouver

Bateup S, Fulbright H, Moberg K, Hair K, Peterson E, Stansfield CM, et al. Evaluating the accuracy and speed of eight deduplication tools: A comparative study. Research Synthesis Methods. 2026;17(6):1144-1157. doi:10.1017/rsm.2026.10100

BibTeX
@article{Bateup2026,
  author = {Bateup, Sarah and Fulbright, Helen and Moberg, Klas and Hair, Kaitlyn and Peterson, Emmy and Stansfield, Claire M and Qureshi, Riaz and Clark, Justin},
  title = {Evaluating the accuracy and speed of eight deduplication tools: A comparative study},
  journal = {Research Synthesis Methods},
  year = {2026},
  volume = {17},
  number = {6},
  pages = {1144--1157},
  doi = {10.1017/rsm.2026.10100}
}
Kostenlos starten →