Comparing the performance of narrow vs. broad search strategies when using machine learning-based software for title/abstract screening
Journal of the Medical Library Association · 13.04.2026 · 114 (2) · 105-115
DOI: 10.5195/jmla.2026.2286 ↗Kurz gefasst
Vergleichsstudie in der Zeitschrift Journal of the Medical Library Association, online erschienen am 13.04.2026. Verfasst von Michelle Swab. Beteiligte Einrichtung: mswab@mun.ca, Public Services Librarian, Health Sciences Library, Memorial University of Newfoundland, St. John's, NL, Canada. Hauptthemen laut MEDLINE: Machine Learning, Software, Information Storage and Retrieval. Die Arbeit wurde bisher 2-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Objective
To retrospectively evaluate workload implications and recall performance of narrower or broader database search strategies when using active learning screening tools.
Methods
A convenience sample of 10 completed reviews was used to assess search strategy performance in ASReview LAB, an open-source systematic review software tool. For each review, a single database search strategy was selected and then revised to either broaden (n = 9) or narrow (n = 1) the scope. Results from both the more sensitive (broader) and more precise (narrower) search strategies were labeled as relevant or irrelevant based on inclusion in the completed review. The labeled result sets were uploaded into the ASReview LAB simulation module, which mimics the process of human screening. Metrics such as number of records screened to reach true recall of 95% or more were recorded. The effects of three different stopping rules on workload and recall were also explored.
Results
For quantitative systematic reviews, the difference in absolute screening time required to reach 95% recall between broader or narrower search strategies was minimal (≤35 minutes). In contrast, for qualitative systematic reviews and other review types, broader search strategies led to increased workload. With respect to stopping rules, the time-based stopping heuristic resulted in substantial workload increases when broader search strategies were employed.
Conclusions
Time savings achieved through the use of semi-automated screening tools may not always offset additional screening time required by broader, more sensitive search strategies. Librarians and information specialists should consider a variety of factors when determining the appropriate balance between search sensitivity and specificity in the context of semi-automated screening tools.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- mswab@mun.ca, Public Services Librarian, Health Sciences Library, Memorial University of Newfoundland, St. John's, NL, Canada.
Zitieren
APA
Swab, M. (2026). Comparing the performance of narrow vs. broad search strategies when using machine learning-based software for title/abstract screening. Journal of the Medical Library Association, 114(2), 105-115. https://doi.org/10.5195/jmla.2026.2286
Vancouver
Swab M. Comparing the performance of narrow vs. broad search strategies when using machine learning-based software for title/abstract screening. Journal of the Medical Library Association. 2026;114(2):105-115. doi:10.5195/jmla.2026.2286
BibTeX
@article{Swab2026,
author = {Swab, Michelle},
title = {Comparing the performance of narrow vs. broad search strategies when using machine learning-based software for title/abstract screening},
journal = {Journal of the Medical Library Association},
year = {2026},
volume = {114},
number = {2},
pages = {105--115},
doi = {10.5195/jmla.2026.2286}
}
EUVIMED