EUVIMEDEUVIMED entdecken
Crossref

Improving the performance of machine learning penicillin adverse drug reaction classification with synthetic data and transfer learning

Viera Stanekova iD, Joshua M Inglis iD, Lydia Lam, Antoinette Lam, William Smith, Sepehr Shakib, Stephen Bacchi iD

Internal Medicine Journal · 2024

DOI: 10.1111/imj.16360 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Internal Medicine Journal, 2024. Verfasst von Viera Stanekova und 6 weiteren Autor:innen. Beteiligte Einrichtung: Royal Adelaide Hospital, Adelaide, South Australia, Australia. Hauptthemen laut MEDLINE: Machine Learning, Penicillins, Electronic Health Records, Natural Language Processing. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 15 Literaturangaben. Gefördert von: Central Adelaide Local Health Network Clinical Rapid Implementation Project Scheme Grant.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Machine learning may assist with the identification of potentially inappropriate penicillin allergy labels. Strategies to improve the performance of existing models for this task include the use of additional training data, synthetic data and transfer learning.

Aims

The aims of this study were to investigate the use of additional training data and novel machine learning strategies, namely synthetic data and transfer learning, to improve the performance of penicillin adverse drug reaction (ADR) machine learning classification.

Methods

Machine learning natural language processing was applied to free‐text penicillin ADR data extracted from a public health system electronic health record (EHR). The models were developed by training on various labelled data sets. ADR entries were split into training and testing data sets and used to develop and test a variety of machine learning models. The effect of training on additional data and synthetic data versus the use of transfer learning was analysed.

Results

Following the application of these techniques, the area under the receiver operator curve of best‐performing models for the classification of penicillin allergy (vs intolerance) and high‐risk allergy (vs low‐risk allergy) improved to 0.984 (using the artificial neural network model) and 0.995 (with the transfer learning approach) respectively.

Conclusions

Machine learning models demonstrate high levels of accuracy in the classification and risk stratification of penicillin ADR labels using the reaction documented in the EHR. The model can be further optimised by incorporating additional training data and using transfer learning. Practical applications include automating case detection for penicillin allergy delabelling programmes.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Machine LearningPenicillinsElectronic Health RecordsNatural Language ProcessingHumansDrug HypersensitivityDrug-Related Side Effects and Adverse ReactionsNeural Networks, ComputerAnti-Bacterial AgentsAdverse Drug Reaction Reporting Systems

Stichwörter der Autor:innen

artificial intelligencedelabellingnatural language processing

Substanzen

PenicillinsAnti-Bacterial Agents

Autor:innen und Institutionen

  • Royal Adelaide Hospital, Adelaide, South Australia, Australia.
  • University of Adelaide, Adelaide, South Australia, Australia.

ORCID-Profile: Viera Stanekova, Joshua M Inglis, Stephen Bacchi

Förderung

  • Central Adelaide Local Health Network Clinical Rapid Implementation Project Scheme Grant

Zitieren

APA

Stanekova, V., Inglis, J. M., Lam, L., Lam, A., Smith, W., Shakib, S., & Bacchi, S. (2024). Improving the performance of machine learning penicillin adverse drug reaction classification with synthetic data and transfer learning. Internal Medicine Journal. https://doi.org/10.1111/imj.16360

Vancouver

Stanekova V, Inglis JM, Lam L, Lam A, Smith W, Shakib S, et al. Improving the performance of machine learning penicillin adverse drug reaction classification with synthetic data and transfer learning. Internal Medicine Journal. 2024. doi:10.1111/imj.16360

BibTeX
@article{Stanekova2024,
  author = {Stanekova, Viera and Inglis, Joshua M and Lam, Lydia and Lam, Antoinette and Smith, William and Shakib, Sepehr and Bacchi, Stephen},
  title = {Improving the performance of machine learning penicillin adverse drug reaction classification with synthetic data and transfer learning},
  journal = {Internal Medicine Journal},
  year = {2024},
  doi = {10.1111/imj.16360}
}
Kostenlos starten →