The 2022 n2c2/UW shared task on extracting social determinants of health
Journal of the American Medical Informatics Association · 2023
DOI: 10.1093/jamia/ocad012 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of the American Medical Informatics Association, 2023. Verfasst von Kevin Lybarger und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Information Sciences and Technology, George Mason University, Fairfax, Virginia, USA. Hauptthemen laut MEDLINE: Social Determinants of Health, Natural Language Processing. Die Arbeit wurde bisher 46-mal zitiert (Crossref) und nennt 43 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: NLM NIH HHS, NCATS NIH HHS, National Institutes of Health.
Abstract (Originalsprache)
Objective
The n2c2/UW SDOH Challenge explores the extraction of social determinant of health (SDOH) information from clinical notes. The objectives include the advancement of natural language processing (NLP) information extraction techniques for SDOH and clinical information more broadly. This article presents the shared task, data, participating teams, performance results, and considerations for future work. Materials and Methods The task used the Social History Annotated Corpus (SHAC), which consists of clinical text with detailed event-based annotations for SDOH events, such as alcohol, drug, tobacco, employment, and living situation. Each SDOH event is characterized through attributes related to status, extent, and temporality. The task includes 3 subtasks related to information extraction (Subtask A), generalizability (Subtask B), and learning transfer (Subtask C). In addressing this task, participants utilized a range of techniques, including rules, knowledge bases, n-grams, word embeddings, and pretrained language models (LM).
Results
A total of 15 teams participated, and the top teams utilized pretrained deep learning LM. The top team across all subtasks used a sequence-to-sequence approach achieving 0.901 F1 for Subtask A, 0.774 F1 Subtask B, and 0.889 F1 for Subtask C.
Conclusions
Similar to many NLP tasks and domains, pretrained LM yielded the best performance, including generalizability and learning transfer. An error analysis indicates extraction performance varies by SDOH, with lower performance achieved for conditions, like substance use and homelessness, which increase health risks (risk factors) and higher performance achieved for conditions, like substance abstinence and living with family, which reduce health risks (protective factors).
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Information Sciences and Technology, George Mason University, Fairfax, Virginia, USA.
- Department of Biomedical Informatics & Medical Education, University of Washington, Seattle, Washington, USA.
ORCID-Profile: Kevin Lybarger, Özlem Uzuner
Förderung
- NLM NIH HHS
- NCATS NIH HHS
- National Institutes of Health
- National Center for Advancing Translational Sciences
- Institute of Translational Health Sciences
- National Library of Medicine
- NLM Biomedical and Health Informatics Training Program
- Seattle Flu Study through the Brotman Baty Institute
Zitieren
APA
Lybarger, K., Yetisgen, M., & Uzuner, Ö. (2023). The 2022 n2c2/UW shared task on extracting social determinants of health. Journal of the American Medical Informatics Association. https://doi.org/10.1093/jamia/ocad012
Vancouver
Lybarger K, Yetisgen M, Uzuner Ö. The 2022 n2c2/UW shared task on extracting social determinants of health. Journal of the American Medical Informatics Association. 2023. doi:10.1093/jamia/ocad012
BibTeX
@article{Lybarger2023,
author = {Lybarger, Kevin and Yetisgen, Meliha and Uzuner, Özlem},
title = {The 2022 n2c2/UW shared task on extracting social determinants of health},
journal = {Journal of the American Medical Informatics Association},
year = {2023},
doi = {10.1093/jamia/ocad012}
}
EUVIMED