Automating literature screening and curation with applications to computational neuroscience
Journal of the American Medical Informatics Association · 2024
DOI: 10.1093/jamia/ocae097 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of the American Medical Informatics Association, 2024. Verfasst von Ziqing Ji und 3 weiteren Autor:innen. Beteiligte Einrichtung: Biostatistics, Yale School of Public Health, Yale University, New Haven, CT 06510, United States. Hauptthemen laut MEDLINE: Neurosciences, Computational Biology. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 26 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Objective
ModelDB (https://modeldb.science) is a discovery platform for computational neuroscience, containing over 1850 published model codes with standardized metadata. These codes were mainly supplied from unsolicited model author submissions, but this approach is inherently limited. For example, we estimate we have captured only around one-third of NEURON models, the most common type of models in ModelDB. To more completely characterize the state of computational neuroscience modeling work, we aim to identify works containing results derived from computational neuroscience approaches and their standardized associated metadata (eg, cell types, research topics). Materials and Methods Known computational neuroscience work from ModelDB and identified neuroscience work queried from PubMed were included in our study. After pre-screening with SPECTER2 (a free document embedding method), GPT-3.5, and GPT-4 were used to identify likely computational neuroscience work and relevant metadata.
Results
SPECTER2, GPT-4, and GPT-3.5 demonstrated varied but high abilities in identification of computational neuroscience work. GPT-4 achieved 96.9% accuracy and GPT-3.5 improved from 54.2% to 85.5% through instruction-tuning and Chain of Thought. GPT-4 also showed high potential in identifying relevant metadata annotations.
Discussion
Accuracy in identification and extraction might further be improved by dealing with ambiguity of what are computational elements, including more information from papers (eg, Methods section), improving prompts, etc.
Conclusion
Natural language processing and large language model techniques can be added to ModelDB to facilitate further model discovery, and will contribute to a more standardized and comprehensive framework for establishing domain-specific resources.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Biostatistics, Yale School of Public Health, Yale University, New Haven, CT 06510, United States.
- Integrative Genomics, Princeton University, Princeton, NJ 08540, United States.
- Biomedical Informatics and Data Science, Yale School of Medicine, Yale University, New Haven, CT 06510, United States.
- Program in Computational Biology and Bioinformatics, Yale University, New Haven, CT 06510, United States.
- Wu Tsai Institute, Yale University, New Haven, CT 06510, United States.
ORCID-Profile: Robert A McDougal
Zitieren
APA
Ji, Z., Guo, S., Qiao, Y., & McDougal, R. A. (2024). Automating literature screening and curation with applications to computational neuroscience. Journal of the American Medical Informatics Association. https://doi.org/10.1093/jamia/ocae097
Vancouver
Ji Z, Guo S, Qiao Y, McDougal RA. Automating literature screening and curation with applications to computational neuroscience. Journal of the American Medical Informatics Association. 2024. doi:10.1093/jamia/ocae097
BibTeX
@article{Ji2024,
author = {Ji, Ziqing and Guo, Siyan and Qiao, Yujie and McDougal, Robert A},
title = {Automating literature screening and curation with applications to computational neuroscience},
journal = {Journal of the American Medical Informatics Association},
year = {2024},
doi = {10.1093/jamia/ocae097}
}
EUVIMED