EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Title and Abstract Screening for Systematic Reviews with Jev, a Decision Model: Comparison with Generative Large Language Models

Kentaro Matsui, Yoshikazu Takaesu

Information · 17.11.2026 · 17 (11) · 1160

DOI: 10.3390/info17111160 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Information, online erschienen am 17.11.2026. Verfasst von Kentaro Matsui und 1 weiteren Autor:innen. Die Arbeit nennt 34 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Japan Society for the Promotion of Science.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

We evaluated Jev, a non-generative decision model, for title and abstract screening using 4527 records from two systematic reviews of bipolar disorder treatments previously used in our 2024 Journal of Medical Internet Research study. Human decisions to retain records for full-text assessment served as the reference. In the primary analysis, Jev answered yes-or-no questions (Noul); at a prespecified 50% cutoff, sensitivity and specificity were 99.6% and 98.9% for light therapy and 93.2% and 93.5% for adjunctive pharmacotherapy. For direct model comparison, Jev used explicit include/exclude options (Choice) and the same prompts as GPT-5 mini and GPT-6 Astra. Jev Choice achieved sensitivity and specificity similar to or higher than those of GPT-5 mini and GPT-6 Astra, while API charges per 1000 records were US$0.043 for Jev, US$0.57 for GPT-5 mini, and US$7.39 for GPT-6 Astra. Jev retained all reports ultimately included in both reviews across all tested conditions and runs. Although these findings do not establish that decision models can replace human reviewers, they support Jev as a promising, low-cost alternative to the tested generative LLM configurations for assisting human title and abstract screening. Independent validation across diverse review topics is needed to assess Jev’s generalizability and utility in human-supervised screening workflows.

Förderung

  • Japan Society for the Promotion of Science

Zitieren

APA

Matsui, K., & Takaesu, Y. (2026). Title and Abstract Screening for Systematic Reviews with Jev, a Decision Model: Comparison with Generative Large Language Models. Information, 17(11), 1160. https://doi.org/10.3390/info17111160

Vancouver

Matsui K, Takaesu Y. Title and Abstract Screening for Systematic Reviews with Jev, a Decision Model: Comparison with Generative Large Language Models. Information. 2026;17(11):1160. doi:10.3390/info17111160

BibTeX
@article{Matsui2026,
  author = {Matsui, Kentaro and Takaesu, Yoshikazu},
  title = {Title and Abstract Screening for Systematic Reviews with Jev, a Decision Model: Comparison with Generative Large Language Models},
  journal = {Information},
  year = {2026},
  volume = {17},
  number = {11},
  pages = {1160},
  doi = {10.3390/info17111160}
}
Kostenlos starten →