STEED: A data mining tool for automated extraction of experimental parameters and risk of bias items from in vivo publications
PLOS ONE · 2024
DOI: 10.1371/journal.pone.0311358 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS ONE, 2024. Verfasst von Wolfgang Emanuel Zurrer und 8 weiteren Autor:innen. Beteiligte Einrichtung: Center for Reproducible Science, University of Zurich, Zurich, Switzerland. Hauptthemen laut MEDLINE: Data Mining. Die Arbeit nennt 28 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung, NINDS, Universität Zürich.
Abstract (Originalsprache)
Background and methods Systematic reviews, i.e., research summaries that address focused questions in a structured and reproducible manner, are a cornerstone of evidence-based medicine and research. However, certain steps in systematic reviews, such as data extraction, are labour-intensive, which hampers their feasibility, especially with the rapidly expanding body of biomedical literature. To bridge this gap, we aimed to develop a data mining tool in the R programming environment to automate data extraction from neuroscience in vivo publications. The function was trained on a literature corpus (n = 45 publications) of animal motor neuron disease studies and tested in two validation corpora (motor neuron diseases, n = 31 publications; multiple sclerosis, n = 244 publications).
Results
Our data mining tool, STEED (STructured Extraction of Experimental Data), successfully extracted key experimental parameters such as animal models and species, as well as risk of bias items like randomization or blinding, from in vivo studies. Sensitivity and specificity were over 85% and 80%, respectively, for most items in both validation corpora. Accuracy and F1-score were above 90% and 0.9 for most items in the validation corpora, respectively. Time savings were above 99%.
Conclusions
Our text mining tool, STEED, can extract key experimental parameters and risk of bias items from the neuroscience in vivo literature. This enables the tool’s deployment for probing a field in a research improvement context or replacing one human reader during data extraction, resulting in substantial time savings and contributing towards the automation of systematic reviews.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Center for Reproducible Science, University of Zurich, Zurich, Switzerland.
- Department of Clinical Neuroscience, Center for Molecular Medicine, Karolinska University Hospital, Karolinska Institute, Stockholm, Sweden.
- Translational Neuroradiology Section, National Institute of Neurological Disorders and Stroke, National Institutes of Health, Bethesda, MD, United States of America.
ORCID-Profile: David Brüschweiler, Daniel Salo Reich, Benjamin Victor Ineichen
Förderung
- Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung
- NINDS
- Universität Zürich
Zitieren
APA
Zurrer, W. E., Cannon, A. E., Ewing, E., Brüschweiler, D., Bugajska, J., Hild, B. F., Rosso, M., Reich, D. S., & Ineichen, B. V. (2024). STEED: A data mining tool for automated extraction of experimental parameters and risk of bias items from in vivo publications. PLOS ONE. https://doi.org/10.1371/journal.pone.0311358
Vancouver
Zurrer WE, Cannon AE, Ewing E, Brüschweiler D, Bugajska J, Hild BF, et al. STEED: A data mining tool for automated extraction of experimental parameters and risk of bias items from in vivo publications. PLOS ONE. 2024. doi:10.1371/journal.pone.0311358
BibTeX
@article{Zurrer2024,
author = {Zurrer, Wolfgang Emanuel and Cannon, Amelia Elaine and Ewing, Ewoud and Brüschweiler, David and Bugajska, Julia and Hild, Bernard Friedrich and Rosso, Marianna and Reich, Daniel Salo and Ineichen, Benjamin Victor},
title = {STEED: A data mining tool for automated extraction of experimental parameters and risk of bias items from in vivo publications},
journal = {PLOS ONE},
year = {2024},
doi = {10.1371/journal.pone.0311358}
}
EUVIMED