EUVIMEDSkopri EUVIMED
Open access

Chemical identification and indexing in full-text articles: an overview of the NLM-Chem track at BioCreative VII

Robert Leaman iD, Rezarta Islamaj iD, Virginia Adams, Mohammed A Alliheedi, João Rafael Almeida, Rui Antunes iD, Robert Bevan, Yung-Chun Chang iD, Arslan Erdengasileng, Matthew Hodgskiss, Ryuki Ida, Hyunjae Kim iD and 9 more

Database · 2023

DOI: 10.1093/database/baad005 ↗

At a glance

Journal article in Database, 2023. Written by Robert Leaman and 20 co-authors. Institution: National Center for Biotechnology Information (NCBI), National Library of Medicine, National Institutes of Health, 8600 Rockville Pike, Bethesda, MD …. Major MEDLINE topics: COVID-19. Cited 9 times so far (Crossref); 71 references. The full text is freely available in PubMed Central. Funded by: Foundation for Science and Technology, Natural Sciences and Engineering Research Council of Canada, H2020 Marie Sklodowska-Curie Actions.

AstrattSubjectsDettalji biblijografiċiCiteRelated studies

Abstract (original language)

The BioCreative National Library of Medicine (NLM)-Chem track calls for a community effort to fine-tune automated recognition of chemical names in the biomedical literature. Chemicals are one of the most searched biomedical entities in PubMed, and—as highlighted during the coronavirus disease 2019 pandemic—their identification may significantly advance research in multiple biomedical subfields. While previous community challenges focused on identifying chemical names mentioned in titles and abstracts, the full text contains valuable additional detail. We, therefore, organized the BioCreative NLM-Chem track as a community effort to address automated chemical entity recognition in full-text articles. The track consisted of two tasks: (i) chemical identification and (ii) chemical indexing. The chemical identification task required predicting all chemicals mentioned in recently published full-text articles, both span [i.e. named entity recognition (NER)] and normalization (i.e. entity linking), using Medical Subject Headings (MeSH). The chemical indexing task required identifying which chemicals reflect topics for each article and should therefore appear in the listing of MeSH terms for the document in the MEDLINE article indexing. This manuscript summarizes the BioCreative NLM-Chem track and post-challenge experiments. We received a total of 85 submissions from 17 teams worldwide. The highest performance achieved for the chemical identification task was 0.8672 F-score (0.8759 precision and 0.8587 recall) for strict NER performance and 0.8136 F-score (0.8621 precision and 0.7702 recall) for strict normalization performance. The highest performance achieved for the chemical indexing task was 0.6073 F-score (0.7417 precision and 0.5141 recall). This community challenge demonstrated that (i) the current substantial achievements in deep learning technologies can be utilized to improve automated prediction accuracy further and (ii) the chemical indexing task is substantially more challenging. We look forward to further developing biomedical text–mining methods to respond to the rapid growth of biomedical literature. The NLM-Chem track dataset and other challenge materials are publicly available at https://ftp.ncbi.nlm.nih.gov/pub/lu/BC7-NLM-Chem-track/. Database URL https://ftp.ncbi.nlm.nih.gov/pub/lu/BC7-NLM-Chem-track/

Subjects

MeSH terms (MEDLINE)

COVID-19United StatesHumansNational Library of Medicine (U.S.)Data MiningDatabases, FactualMEDLINE

Authors and institutions

  • National Center for Biotechnology Information (NCBI), National Library of Medicine, National Institutes of Health, 8600 Rockville Pike, Bethesda, MD 20894, USA.
  • NVIDIA, 2788 San Tomas Expressway, Santa Clara, CA 95051, USA.
  • Department of Computer Science, Al Baha University, 4781 King Fahd Rd, Al Aqiq 65779, Saudi Arabia.
  • Department of Electronics, Telecommunications and Informatics (DETI), Institute of Electronics and Informatics Engineering of Aveiro (IEETA), University of Aveiro, Campus Universitário de Santiago, Aveiro 3810-193, Port…
  • Department of Information and Communications Technologies, University of A Coruña, Camiño do Lagar de Castro, A Coruña 15008, Spain.
  • Informatics Department, Medicines Discovery Catapult, Alderley Park, Block 35, Mereside, Macclesfield SK10 4ZF, UK.

ORCID profiles: Robert Leaman, Rezarta Islamaj, Rui Antunes, Yung-Chun Chang, Hyunjae Kim, Mujeen Sung, Wen-Chao Yeh, Zhiyong Lu

Funding

  • Foundation for Science and Technology
  • Natural Sciences and Engineering Research Council of Canada
  • H2020 Marie Sklodowska-Curie Actions
  • U.S. National Library of Medicine
  • Albaha University

Cite

APA

Leaman, R., Islamaj, R., Adams, V., Alliheedi, M. A., Almeida, J. R., Antunes, R., Bevan, R., Chang, Y. C., Erdengasileng, A., Hodgskiss, M., Ida, R., Kim, H., Li, K., Mercer, R. E., Mertová, L., Mobasher, G., Shin, H. C., Sung, M., Tsujimura, T., …, & Lu, Z. (2023). Chemical identification and indexing in full-text articles: an overview of the NLM-Chem track at BioCreative VII. Database. https://doi.org/10.1093/database/baad005

Vancouver

Leaman R, Islamaj R, Adams V, Alliheedi MA, Almeida JR, Antunes R, et al. Chemical identification and indexing in full-text articles: an overview of the NLM-Chem track at BioCreative VII. Database. 2023. doi:10.1093/database/baad005

BibTeX
@article{Leaman2023,
  author = {Leaman, Robert and Islamaj, Rezarta and Adams, Virginia and Alliheedi, Mohammed A and Almeida, João Rafael and Antunes, Rui and Bevan, Robert and Chang, Yung-Chun and Erdengasileng, Arslan and Hodgskiss, Matthew and Ida, Ryuki and Kim, Hyunjae and Li, Keqiao and Mercer, Robert E and Mertová, Lukrécia and Mobasher, Ghadeer and Shin, Hoo-Chang and Sung, Mujeen and Tsujimura, Tomoki and Yeh, Wen-Chao and Lu, Zhiyong},
  title = {Chemical identification and indexing in full-text articles: an overview of the NLM-Chem track at BioCreative VII},
  journal = {Database},
  year = {2023},
  doi = {10.1093/database/baad005}
}
Start for free →