EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

HEalthRecordBERT (HERBERT): Leveraging Transformers on Electronic Health Records for Chronic Kidney Disease Risk Stratification

Alex Moore, Bastien Orset, Arrash Yassaee, Benjamin Irving, Davide Morelli

ACM Transactions on Computing for Healthcare · 31.07.2024 · 5 (3) · 1-18

DOI: 10.1145/3665899 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Computing for Healthcare, online erschienen am 18.09.2024. Verfasst von Alex Moore und 4 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 38 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Risk stratification is an essential tool in the fight against many diseases, including chronic kidney disease. Recent work has focused on applying techniques from machine learning and leveraging the information contained in a patient’s electronic health record (EHR). Irregular intervals between data entries and the large number of variables tracked in EHR datasets can make them challenging to work with. Many of the difficulties associated with these datasets can be overcome by using large language models, such as bidirectional encoder representations from transformers (BERT). Previous attempts to apply BERT to EHR for risk stratification have shown promise. In this work we propose HERBERT, a novel application of BERT to EHR data. We identify two key areas where BERT models must be modified to adapt them to EHR data, namely: the embedding layer and the pretraining task. We show how changes to these can lead to improved performance, relative to the previous state of the art. We evaluate our model by predicting the transition of chronic kidney disease patients to end stage renal disease. The strong performance of our model justifies our architectural changes and suggests that large language models could play an important role in future renal risk stratification.

Zitieren

APA

Moore, A., Orset, B., Yassaee, A., Irving, B., & Morelli, D. (2024). HEalthRecordBERT (HERBERT): Leveraging Transformers on Electronic Health Records for Chronic Kidney Disease Risk Stratification. ACM Transactions on Computing for Healthcare, 5(3), 1-18. https://doi.org/10.1145/3665899

Vancouver

Moore A, Orset B, Yassaee A, Irving B, Morelli D. HEalthRecordBERT (HERBERT): Leveraging Transformers on Electronic Health Records for Chronic Kidney Disease Risk Stratification. ACM Transactions on Computing for Healthcare. 2024;5(3):1-18. doi:10.1145/3665899

BibTeX
@article{Moore2024,
  author = {Moore, Alex and Orset, Bastien and Yassaee, Arrash and Irving, Benjamin and Morelli, Davide},
  title = {HEalthRecordBERT (HERBERT): Leveraging Transformers on Electronic Health Records for Chronic Kidney Disease Risk Stratification},
  journal = {ACM Transactions on Computing for Healthcare},
  year = {2024},
  volume = {5},
  number = {3},
  pages = {1--18},
  doi = {10.1145/3665899}
}
Kostenlos starten →