Improving the performance of machine learning penicillin adverse drug reaction classification with synthetic data and transfer learning
Internal Medicine Journal · 2024
DOI: 10.1111/imj.16360 ↗Kurz gefasst
Fachartikel in der Zeitschrift Internal Medicine Journal, 2024. Verfasst von Viera Stanekova und 6 weiteren Autor:innen. Beteiligte Einrichtung: Royal Adelaide Hospital, Adelaide, South Australia, Australia. Hauptthemen laut MEDLINE: Machine Learning, Penicillins, Electronic Health Records, Natural Language Processing. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 15 Literaturangaben. Gefördert von: Central Adelaide Local Health Network Clinical Rapid Implementation Project Scheme Grant.
Abstract (Originalsprache)
Background
Machine learning may assist with the identification of potentially inappropriate penicillin allergy labels. Strategies to improve the performance of existing models for this task include the use of additional training data, synthetic data and transfer learning.
Aims
The aims of this study were to investigate the use of additional training data and novel machine learning strategies, namely synthetic data and transfer learning, to improve the performance of penicillin adverse drug reaction (ADR) machine learning classification.
Methods
Machine learning natural language processing was applied to free‐text penicillin ADR data extracted from a public health system electronic health record (EHR). The models were developed by training on various labelled data sets. ADR entries were split into training and testing data sets and used to develop and test a variety of machine learning models. The effect of training on additional data and synthetic data versus the use of transfer learning was analysed.
Results
Following the application of these techniques, the area under the receiver operator curve of best‐performing models for the classification of penicillin allergy (vs intolerance) and high‐risk allergy (vs low‐risk allergy) improved to 0.984 (using the artificial neural network model) and 0.995 (with the transfer learning approach) respectively.
Conclusions
Machine learning models demonstrate high levels of accuracy in the classification and risk stratification of penicillin ADR labels using the reaction documented in the EHR. The model can be further optimised by incorporating additional training data and using transfer learning. Practical applications include automating case detection for penicillin allergy delabelling programmes.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Substanzen
Autor:innen und Institutionen
- Royal Adelaide Hospital, Adelaide, South Australia, Australia.
- University of Adelaide, Adelaide, South Australia, Australia.
ORCID-Profile: Viera Stanekova, Joshua M Inglis, Stephen Bacchi
Förderung
- Central Adelaide Local Health Network Clinical Rapid Implementation Project Scheme Grant
Zitieren
APA
Stanekova, V., Inglis, J. M., Lam, L., Lam, A., Smith, W., Shakib, S., & Bacchi, S. (2024). Improving the performance of machine learning penicillin adverse drug reaction classification with synthetic data and transfer learning. Internal Medicine Journal. https://doi.org/10.1111/imj.16360
Vancouver
Stanekova V, Inglis JM, Lam L, Lam A, Smith W, Shakib S, et al. Improving the performance of machine learning penicillin adverse drug reaction classification with synthetic data and transfer learning. Internal Medicine Journal. 2024. doi:10.1111/imj.16360
BibTeX
@article{Stanekova2024,
author = {Stanekova, Viera and Inglis, Joshua M and Lam, Lydia and Lam, Antoinette and Smith, William and Shakib, Sepehr and Bacchi, Stephen},
title = {Improving the performance of machine learning penicillin adverse drug reaction classification with synthetic data and transfer learning},
journal = {Internal Medicine Journal},
year = {2024},
doi = {10.1111/imj.16360}
}
EUVIMED