EUVIMEDEUVIMED entdecken
Open Access

Automating literature screening and curation with applications to computational neuroscience

Ziqing Ji, Siyan Guo, Yujie Qiao, Robert A McDougal iD

Journal of the American Medical Informatics Association · 2024

DOI: 10.1093/jamia/ocae097 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of the American Medical Informatics Association, 2024. Verfasst von Ziqing Ji und 3 weiteren Autor:innen. Beteiligte Einrichtung: Biostatistics, Yale School of Public Health, Yale University, New Haven, CT 06510, United States. Hauptthemen laut MEDLINE: Neurosciences, Computational Biology. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 26 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Objective

ModelDB (https://modeldb.science) is a discovery platform for computational neuroscience, containing over 1850 published model codes with standardized metadata. These codes were mainly supplied from unsolicited model author submissions, but this approach is inherently limited. For example, we estimate we have captured only around one-third of NEURON models, the most common type of models in ModelDB. To more completely characterize the state of computational neuroscience modeling work, we aim to identify works containing results derived from computational neuroscience approaches and their standardized associated metadata (eg, cell types, research topics). Materials and Methods Known computational neuroscience work from ModelDB and identified neuroscience work queried from PubMed were included in our study. After pre-screening with SPECTER2 (a free document embedding method), GPT-3.5, and GPT-4 were used to identify likely computational neuroscience work and relevant metadata.

Results

SPECTER2, GPT-4, and GPT-3.5 demonstrated varied but high abilities in identification of computational neuroscience work. GPT-4 achieved 96.9% accuracy and GPT-3.5 improved from 54.2% to 85.5% through instruction-tuning and Chain of Thought. GPT-4 also showed high potential in identifying relevant metadata annotations.

Discussion

Accuracy in identification and extraction might further be improved by dealing with ambiguity of what are computational elements, including more information from papers (eg, Methods section), improving prompts, etc.

Conclusion

Natural language processing and large language model techniques can be added to ModelDB to facilitate further model discovery, and will contribute to a more standardized and comprehensive framework for establishing domain-specific resources.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

NeurosciencesComputational BiologyHumansMetadataData CurationModels, NeurologicalData MiningDatabases, Factual

Stichwörter der Autor:innen

automated curationcomputational neurosciencelarge language modelnatural language processing

Autor:innen und Institutionen

  • Biostatistics, Yale School of Public Health, Yale University, New Haven, CT 06510, United States.
  • Integrative Genomics, Princeton University, Princeton, NJ 08540, United States.
  • Biomedical Informatics and Data Science, Yale School of Medicine, Yale University, New Haven, CT 06510, United States.
  • Program in Computational Biology and Bioinformatics, Yale University, New Haven, CT 06510, United States.
  • Wu Tsai Institute, Yale University, New Haven, CT 06510, United States.

ORCID-Profile: Robert A McDougal

Zitieren

APA

Ji, Z., Guo, S., Qiao, Y., & McDougal, R. A. (2024). Automating literature screening and curation with applications to computational neuroscience. Journal of the American Medical Informatics Association. https://doi.org/10.1093/jamia/ocae097

Vancouver

Ji Z, Guo S, Qiao Y, McDougal RA. Automating literature screening and curation with applications to computational neuroscience. Journal of the American Medical Informatics Association. 2024. doi:10.1093/jamia/ocae097

BibTeX
@article{Ji2024,
  author = {Ji, Ziqing and Guo, Siyan and Qiao, Yujie and McDougal, Robert A},
  title = {Automating literature screening and curation with applications to computational neuroscience},
  journal = {Journal of the American Medical Informatics Association},
  year = {2024},
  doi = {10.1093/jamia/ocae097}
}
Kostenlos starten →