The overview of the BioRED (Biomedical Relation Extraction Dataset) track at BioCreative VIII
Database · 01.10.2024 · 2024
DOI: 10.1093/database/baae069 ↗Kurz gefasst
Fachartikel in der Zeitschrift Database, online erschienen am 08.08.2024. Verfasst von Rezarta Islamaj und 22 weiteren Autor:innen. Beteiligte Einrichtung: National Center for Biotechnology Information (NCBI), National Library of Medicine (NLM), National Institutes of Health (NIH), 8600 Rockville Pike, B…. Hauptthemen laut MEDLINE: Natural Language Processing, Data Mining. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 60 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: Research Unit, Russian Science Foundation, Kazan Federal University.
Abstract (Originalsprache)
The BioRED track at BioCreative VIII calls for a community effort to identify, semantically categorize, and highlight the novelty factor of the relationships between biomedical entities in unstructured text. Relation extraction is crucial for many biomedical natural language processing (NLP) applications, from drug discovery to custom medical solutions. The BioRED track simulates a real-world application of biomedical relationship extraction, and as such, considers multiple biomedical entity types, normalized to their specific corresponding database identifiers, as well as defines relationships between them in the documents. The challenge consisted of two subtasks: (i) in Subtask 1, participants were given the article text and human expert annotated entities, and were asked to extract the relation pairs, identify their semantic type and the novelty factor, and (ii) in Subtask 2, participants were given only the article text, and were asked to build an end-to-end system that could identify and categorize the relationships and their novelty. We received a total of 94 submissions from 14 teams worldwide. The highest F-score performances achieved for the Subtask 1 were: 77.17% for relation pair identification, 58.95% for relation type identification, 59.22% for novelty identification, and 44.55% when evaluating all of the above aspects of the comprehensive relation extraction. The highest F-score performances achieved for the Subtask 2 were: 55.84% for relation pair, 43.03% for relation type, 42.74% for novelty, and 32.75% for comprehensive relation extraction. The entire BioRED track dataset and other challenge materials are available at https://ftp.ncbi.nlm.nih.gov/pub/lu/BC8-BioRED-track/ and https://codalab.lisn.upsaclay.fr/competitions/13377 and https://codalab.lisn.upsaclay.fr/competitions/13378. Database URL: https://ftp.ncbi.nlm.nih.gov/pub/lu/BC8-BioRED-track/https://codalab.lisn.upsaclay.fr/competitions/13377https://codalab.lisn.upsaclay.fr/competitions/13378
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- National Center for Biotechnology Information (NCBI), National Library of Medicine (NLM), National Institutes of Health (NIH), 8600 Rockville Pike, Bethesda, MD 20894, United States.
- School of Computer Science and Technology, Dalian University of Technology, No. 2 Linggong Road, Ganjingzi District, Dalian 116024, China.
- Department of Electronics, Telecommunications and Informatics (DETI), Institute of Electronics and Informatics Engineering of Aveiro (IEETA), University of Aveiro, Campus Universitário de Santiago, Aveiro 3810-193, Port…
- Departamento de Informática, Faculdade de Ciências da Universidade de Lisboa, Edifício C6 Campo Grande, Lisbon 1749-016, Portugal.
- Department of Computer Science and Information Engineering, National Cheng Kung University, No.1, University Road, Tainan City 701, Taiwan, Republic of China.
- Department of Computer Science and Information Engineering, National Central University, No. 300, Zhongda Rd., Zhongli District, Taoyuan City 32001, Taiwan, Republic of China.
ORCID-Profile: Rezarta Islamaj, Chih-Hsuan Wei, Ling Luo, Tiago Almeida, Jiru Li, M Janina Sarol, Elena Tutubalina, Yi-Yu Hsu, Karin Verspoor, Zhiyong Lu
Förderung
- Research Unit
- Russian Science Foundation
- Kazan Federal University
- LASIGE Computer Science and Engineering Research Centre
- Fundamental Research Funds for the Central Universities
- Fct
- Fundação para a Ciência e a Tecnologia (FCT)
- the NIH Intramural Research Program, National Library of Medicine
Zitieren
APA
Islamaj, R., Lai, P. T., Wei, C. H., Luo, L., Almeida, T., Jonker, R. A. A., Conceição, S. I. R., Sousa, D. F., Phan, C. P., Chiang, J. H., Li, J., Pan, D., Meesawad, W., Tsai, R. T., Sarol, M. J., Hong, G., Valiev, A., Tutubalina, E., Lee, S. M., …, & Lu, Z. (2024). The overview of the BioRED (Biomedical Relation Extraction Dataset) track at BioCreative VIII. Database, 2024. https://doi.org/10.1093/database/baae069
Vancouver
Islamaj R, Lai PT, Wei CH, Luo L, Almeida T, Jonker RAA, et al. The overview of the BioRED (Biomedical Relation Extraction Dataset) track at BioCreative VIII. Database. 2024;2024. doi:10.1093/database/baae069
BibTeX
@article{Islamaj2024,
author = {Islamaj, Rezarta and Lai, Po-Ting and Wei, Chih-Hsuan and Luo, Ling and Almeida, Tiago and Jonker, Richard A A and Conceição, Sofia I R and Sousa, Diana F and Phan, Cong-Phuoc and Chiang, Jung-Hsien and Li, Jiru and Pan, Dinghao and Meesawad, Wilailack and Tsai, Richard Tzong-Han and Sarol, M Janina and Hong, Gibong and Valiev, Airat and Tutubalina, Elena and Lee, Shao-Man and Hsu, Yi-Yu and Li, Mingjie and Verspoor, Karin and Lu, Zhiyong},
title = {The overview of the BioRED (Biomedical Relation Extraction Dataset) track at BioCreative VIII},
journal = {Database},
year = {2024},
volume = {2024},
doi = {10.1093/database/baae069}
}
EUVIMED