Question Answering for Electronic Health Records: Scoping Review of Datasets and Models
Journal of Medical Internet Research · 2024-10-30 · 26 · e53636
DOI: 10.2196/53636 ↗At a glance
Scoping Review in Journal of Medical Internet Research, published online on 2024-10-30. Written by Jayetri Bardhan and 2 co-authors. Institution: Department of Computer and Information Science and Engineering, University of Florida, Gainesville, FL, United States. Major MEDLINE topics: Electronic Health Records. Cited 15 times so far (Crossref); 87 references. The full text is freely available in PubMed Central. Funded by: NLM NIH HHS, NIBIB NIH HHS.
Abstract (original language)
Background
Question answering (QA) systems for patient-related data can assist both clinicians and patients. They can, for example, assist clinicians in decision-making and enable patients to have a better understanding of their medical history. Substantial amounts of patient data are stored in electronic health records (EHRs), making EHR QA an important research area. Because of the differences in data format and modality, this differs greatly from other medical QA tasks that use medical websites or scientific papers to retrieve answers, making it critical to research EHR QA.
Objective
This study aims to provide a methodological review of existing works on QA for EHRs. The objectives of this study were to identify the existing EHR QA datasets and analyze them, study the state-of-the-art methodologies used in this task, compare the different evaluation metrics used by these state-of-the-art models, and finally elicit the various challenges and the ongoing issues in EHR QA.
Methods
We searched for articles from January 1, 2005, to September 30, 2023, in 4 digital sources, including Google Scholar, ACL Anthology, ACM Digital Library, and PubMed, to collect relevant publications on EHR QA. Our systematic screening process followed PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. A total of 4111 papers were identified for our study, and after screening based on our inclusion criteria, we obtained 47 papers for further study. The selected studies were then classified into 2 non–mutually exclusive categories depending on their scope: “EHR QA datasets” and “EHR QA models.” Results A systematic screening process obtained 47 papers on EHR QA for final review. Out of the 47 papers, 53% (n=25) were about EHR QA datasets, and 79% (n=37) papers were about EHR QA models. It was observed that QA on EHRs is relatively new and unexplored. Most of the works are fairly recent. In addition, it was observed that emrQA is by far the most popular EHR QA dataset, both in terms of citations and usage in other papers. We have classified the EHR QA datasets based on their modality, and we have inferred that Medical Information Mart for Intensive Care (MIMIC-III) and the National Natural Language Processing Clinical Challenges datasets (ie, n2c2 datasets) are the most popular EHR databases and corpuses used in EHR QA. Furthermore, we identified the different models used in EHR QA along with the evaluation metrics used for these models.
Conclusions
EHR QA research faces multiple challenges, such as the limited availability of clinical annotations, concept normalization in EHR QA, and challenges faced in generating realistic EHR QA datasets. There are still many gaps in research that motivate further work. This study will assist future researchers in focusing on areas of EHR QA that have possible future research directions.
Subjects
MeSH terms (MEDLINE)
Author keywords
Authors and institutions
- Department of Computer and Information Science and Engineering, University of Florida, Gainesville, FL, United States.
- School of Biomedical Informatics, The University of Texas Health Science Center at Houston, Houston, TX, United States.
ORCID profiles: Jayetri Bardhan, Kirk Roberts, Daisy Zhe Wang
Funding
- NLM NIH HHS
- NIBIB NIH HHS
Cite
APA
Bardhan, J., Roberts, K., & Wang, D. Z. (2024). Question Answering for Electronic Health Records: Scoping Review of Datasets and Models. Journal of Medical Internet Research, 26, e53636. https://doi.org/10.2196/53636
Vancouver
Bardhan J, Roberts K, Wang DZ. Question Answering for Electronic Health Records: Scoping Review of Datasets and Models. Journal of Medical Internet Research. 2024;26:e53636. doi:10.2196/53636
BibTeX
@article{Bardhan2024,
author = {Bardhan, Jayetri and Roberts, Kirk and Wang, Daisy Zhe},
title = {Question Answering for Electronic Health Records: Scoping Review of Datasets and Models},
journal = {Journal of Medical Internet Research},
year = {2024},
volume = {26},
pages = {e53636},
doi = {10.2196/53636}
}
EUVIMED