EUVIMEDEUVIMED entdecken
Systematische Übersicht

Simulated changes in systematic review screening sensitivity and specificity associated with varying co-screening proportions

Shaun Prentice iD, Ben Mundy iD, Caitlin Prentice iD, Diana Dorstyn iD, Nicola Massy-Westropp iD, Ishanka Weerasekara iD, Michael Bentley iD, Katie Fisher, Sahil Kharwadkar iD, Thuy Tran iD

JBI Evidence Synthesis · 22.07.2026

DOI: 10.11124/jbies-25-00309 ↗

Kurz gefasst

Systematische Übersicht in der Zeitschrift JBI Evidence Synthesis, online erschienen am 22.07.2026. Verfasst von Shaun Prentice und 9 weiteren Autor:innen. Beteiligte Einrichtung: School of Psychology, College of Education, Behavioural and Social Sciences, Adelaide University, Adelaide, SA, Australia. Die Arbeit nennt 19 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Objective

The objective of this study was to examine how sensitivity and specificity of title/abstract screening decisions change as the proportion of records that are co-screened is varied.

Introduction

With an accelerating volume of literature being published, the demand for systematic reviews is increasing. To maintain the feasibility of conducting reviews in a timely fashion, efficiencies must be found in the review process that do not compromise their rigor. Current guidelines recommend that all records be dual-screened. Less is known about the impact of co-screening a subset of records on screening accuracy.

Methods

Eight reviewers independently screened the titles and abstracts from a published systematic review and meta-analysis. Using their decisions, simulations were run to generate permutations of reviewer combinations in 2 formats: dual screening (ie, primary reviewer screened all records, secondary reviewer screened a portion, third reviewer mediated disagreements) and 3-way screening (ie, primary reviewer, secondary reviewer, and mediator roles were equally divided between 3 individuals). Within each permutation, further simulations were created so that the secondary reviewer screened increasing proportions of records in 5% increments. Decisions were compared against the final full-text decisions used in the published review to determine sensitivity and specificity of decisions for each permutation, at each increment. The relationship between sensitivity/specificity and percentage of co-screening was assessed using linear mixed-effects models.

Results

All reviewers screened 3891 potentially eligible records, of which 80 were included in the final review. Sensitivity (median range: 93.3%-96.3%) and specificity (median range: 87.7%-89.6%) were stable across different proportions of co-screening, for both dual- and 3-way screening strategies. Sensitivity was higher in reviewer groupings where at least one reviewer had subject matter experience. Specificity tended to be higher when the primary reviewer had experience in conducting a systematic review.

Discussion

Our results suggest that complete co-screening of title/abstract records does not appreciably improve sensitivity or specificity. Rather, even low levels of co-screening across dual- and 3-way screening can produce high accuracy. Reviewer experience in subject matter and in conducting a systematic review, however, appear to be influential. These results are based on simulations and permutations from a single review so should be used as a guide only.

Conclusion

Co-screening a proportion of title/abstracts in a systematic review appears to produce comparable sensitivity and specificity to co-screening all records. Proportional co-screening may therefore represent an opportunity for enhancing efficiency in the systematic review process. Review registration: https://osf.io/9feuh

Schlagwörter

Stichwörter der Autor:innen

record screeningstudy within a reviewsystematic review

Autor:innen und Institutionen

  • School of Psychology, College of Education, Behavioural and Social Sciences, Adelaide University, Adelaide, SA, Australia.
  • GP Training Research Team, The Royal Australian College of General Practitioners, Adelaide, SA, Australia.
  • School of Allied Health and Human Performance, College of Health, Adelaide University, Adelaide, SA, Australia.
  • Institute of Health and Wellbeing, Federation University, Churchill, VIC, Australia.
  • School of Health Sciences, University of Newcastle, Callaghan, NSW, Australia.
  • School of Medicine and Public Health, University of Newcastle, Callaghan, NSW, Australia.

ORCID-Profile: Shaun Prentice, Ben Mundy, Caitlin Prentice, Diana Dorstyn, Nicola Massy-Westropp, Ishanka Weerasekara, Michael Bentley, Sahil Kharwadkar, Thuy Tran

Zitieren

APA

Prentice, S., Mundy, B., Prentice, C., Dorstyn, D., Massy-Westropp, N., Weerasekara, I., Bentley, M., Fisher, K., Kharwadkar, S., & Tran, T. (2026). Simulated changes in systematic review screening sensitivity and specificity associated with varying co-screening proportions. JBI Evidence Synthesis. https://doi.org/10.11124/jbies-25-00309

Vancouver

Prentice S, Mundy B, Prentice C, Dorstyn D, Massy-Westropp N, Weerasekara I, et al. Simulated changes in systematic review screening sensitivity and specificity associated with varying co-screening proportions. JBI Evidence Synthesis. 2026. doi:10.11124/jbies-25-00309

BibTeX
@article{Prentice2026,
  author = {Prentice, Shaun and Mundy, Ben and Prentice, Caitlin and Dorstyn, Diana and Massy-Westropp, Nicola and Weerasekara, Ishanka and Bentley, Michael and Fisher, Katie and Kharwadkar, Sahil and Tran, Thuy},
  title = {Simulated changes in systematic review screening sensitivity and specificity associated with varying co-screening proportions},
  journal = {JBI Evidence Synthesis},
  year = {2026},
  doi = {10.11124/jbies-25-00309}
}
Kostenlos starten →