EUVIMEDEUVIMED entdecken
Systematische ÜbersichtOpen Access

Accelerating Evidence Synthesis in Observational Studies: Development of a Living Natural Language Processing–Assisted Intelligent Systematic Literature Review System

Frank J Manion iD, Jingcheng Du iD, Dong Wang iD, Long He, Bin Lin, Jingqi Wang iD, Siwei Wang iD, David Eckels iD, Jan Cervenka iD, Peter C Fiduccia iD, Nicole Cossrow iD, Lixia Yao iD

JMIR Medical Informatics · 2024

DOI: 10.2196/54653 ↗

Kurz gefasst

Systematische Übersicht in der Zeitschrift JMIR Medical Informatics, 2024. Verfasst von Frank J Manion und 11 weiteren Autor:innen. Beteiligte Einrichtung: IMO Health, 9600 W Bryn Mawr Ave # 100, Rosemont, IL, 60018, United States. Hauptthemen laut MEDLINE: Natural Language Processing, Observational Studies as Topic, Systematic Reviews as Topic. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 25 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Systematic literature review (SLR), a robust method to identify and summarize evidence from published sources, is considered to be a complex, time-consuming, labor-intensive, and expensive task.

Objective

This study aimed to present a solution based on natural language processing (NLP) that accelerates and streamlines the SLR process for observational studies using real-world data.

Methods

We followed an agile software development and iterative software engineering methodology to build a customized intelligent end-to-end living NLP-assisted solution for observational SLR tasks. Multiple machine learning–based NLP algorithms were adopted to automate article screening and data element extraction processes. The NLP prediction results can be further reviewed and verified by domain experts, following the human-in-the-loop design. The system integrates explainable articificial intelligence to provide evidence for NLP algorithms and add transparency to extracted literature data elements. The system was developed based on 3 existing SLR projects of observational studies, including the epidemiology studies of human papillomavirus–associated diseases, the disease burden of pneumococcal diseases, and cost-effectiveness studies on pneumococcal vaccines.

Results

Our Intelligent SLR Platform covers major SLR steps, including study protocol setting, literature retrieval, abstract screening, full-text screening, data element extraction from full-text articles, results summary, and data visualization. The NLP algorithms achieved accuracy scores of 0.86-0.90 on article screening tasks (framed as text classification tasks) and macroaverage F1 scores of 0.57-0.89 on data element extraction tasks (framed as named entity recognition tasks).

Conclusions

Cutting-edge NLP algorithms expedite SLR for observational studies, thus allowing scientists to have more time to focus on the quality of data and the synthesis of evidence in observational studies. Aligning the living SLR concept, the system has the potential to update literature data and enable scientists to easily stay current with the literature related to observational studies prospectively and continuously.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Natural Language ProcessingObservational Studies as TopicSystematic Reviews as TopicHumansAlgorithmsMachine LearningSoftware

Stichwörter der Autor:innen

artificial intelligencedata extractiondeep learningepidemiologymachine learningnatural language processingsoftware developmentsystematic literature review

Autor:innen und Institutionen

  • IMO Health, 9600 W Bryn Mawr Ave # 100, Rosemont, IL, 60018, United States.
  • Merck & Co, Inc, 126 East Lincoln Ave, Rahway, NJ, United States, 1 619-643-2693.

ORCID-Profile: Frank J Manion, Jingcheng Du, Dong Wang, Jingqi Wang, Siwei Wang, David Eckels, Jan Cervenka, Peter C Fiduccia, Nicole Cossrow, Lixia Yao

Zitieren

APA

Manion, F. J., Du, J., Wang, D., He, L., Lin, B., Wang, J., Wang, S., Eckels, D., Cervenka, J., Fiduccia, P. C., Cossrow, N., & Yao, L. (2024). Accelerating Evidence Synthesis in Observational Studies: Development of a Living Natural Language Processing–Assisted Intelligent Systematic Literature Review System. JMIR Medical Informatics. https://doi.org/10.2196/54653

Vancouver

Manion FJ, Du J, Wang D, He L, Lin B, Wang J, et al. Accelerating Evidence Synthesis in Observational Studies: Development of a Living Natural Language Processing–Assisted Intelligent Systematic Literature Review System. JMIR Medical Informatics. 2024. doi:10.2196/54653

BibTeX
@article{Manion2024,
  author = {Manion, Frank J and Du, Jingcheng and Wang, Dong and He, Long and Lin, Bin and Wang, Jingqi and Wang, Siwei and Eckels, David and Cervenka, Jan and Fiduccia, Peter C and Cossrow, Nicole and Yao, Lixia},
  title = {Accelerating Evidence Synthesis in Observational Studies: Development of a Living Natural Language Processing–Assisted Intelligent Systematic Literature Review System},
  journal = {JMIR Medical Informatics},
  year = {2024},
  doi = {10.2196/54653}
}
Kostenlos starten →