EUVIMEDEUVIMED entdecken
VergleichsstudieOpen Access · CC BY 4.0

Comparing the performance of narrow vs. broad search strategies when using machine learning-based software for title/abstract screening

Michelle Swab

Journal of the Medical Library Association · 13.04.2026 · 114 (2) · 105-115

DOI: 10.5195/jmla.2026.2286 ↗

Kurz gefasst

Vergleichsstudie in der Zeitschrift Journal of the Medical Library Association, online erschienen am 13.04.2026. Verfasst von Michelle Swab. Beteiligte Einrichtung: mswab@mun.ca, Public Services Librarian, Health Sciences Library, Memorial University of Newfoundland, St. John's, NL, Canada. Hauptthemen laut MEDLINE: Machine Learning, Software, Information Storage and Retrieval. Die Arbeit wurde bisher 2-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Objective

To retrospectively evaluate workload implications and recall performance of narrower or broader database search strategies when using active learning screening tools.

Methods

A convenience sample of 10 completed reviews was used to assess search strategy performance in ASReview LAB, an open-source systematic review software tool. For each review, a single database search strategy was selected and then revised to either broaden (n = 9) or narrow (n = 1) the scope. Results from both the more sensitive (broader) and more precise (narrower) search strategies were labeled as relevant or irrelevant based on inclusion in the completed review. The labeled result sets were uploaded into the ASReview LAB simulation module, which mimics the process of human screening. Metrics such as number of records screened to reach true recall of 95% or more were recorded. The effects of three different stopping rules on workload and recall were also explored.

Results

For quantitative systematic reviews, the difference in absolute screening time required to reach 95% recall between broader or narrower search strategies was minimal (≤35 minutes). In contrast, for qualitative systematic reviews and other review types, broader search strategies led to increased workload. With respect to stopping rules, the time-based stopping heuristic resulted in substantial workload increases when broader search strategies were employed.

Conclusions

Time savings achieved through the use of semi-automated screening tools may not always offset additional screening time required by broader, more sensitive search strategies. Librarians and information specialists should consider a variety of factors when determining the appropriate balance between search sensitivity and specificity in the context of semi-automated screening tools.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Machine LearningSoftwareInformation Storage and RetrievalHumansWorkloadRetrospective Studies

Stichwörter der Autor:innen

AIScreening Toolsevidence synthesis as topicmachine learningsearch strategy developmentsystematic review as topic

Autor:innen und Institutionen

  • mswab@mun.ca, Public Services Librarian, Health Sciences Library, Memorial University of Newfoundland, St. John's, NL, Canada.

Zitieren

APA

Swab, M. (2026). Comparing the performance of narrow vs. broad search strategies when using machine learning-based software for title/abstract screening. Journal of the Medical Library Association, 114(2), 105-115. https://doi.org/10.5195/jmla.2026.2286

Vancouver

Swab M. Comparing the performance of narrow vs. broad search strategies when using machine learning-based software for title/abstract screening. Journal of the Medical Library Association. 2026;114(2):105-115. doi:10.5195/jmla.2026.2286

BibTeX
@article{Swab2026,
  author = {Swab, Michelle},
  title = {Comparing the performance of narrow vs. broad search strategies when using machine learning-based software for title/abstract screening},
  journal = {Journal of the Medical Library Association},
  year = {2026},
  volume = {114},
  number = {2},
  pages = {105--115},
  doi = {10.5195/jmla.2026.2286}
}
Kostenlos starten →