EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Deep Transfer Learning with Enhanced Feature Fusion for Detection of Abnormalities in X-ray Images

Zaenab Alammar iD, Laith Alzubaidi iD, Jinglan Zhang, Yuefeng Li iD, Waail Lafta iD, Yuantong Gu

Cancers · 07.08.2023 · 15 (15) · 4007

DOI: 10.3390/cancers15154007 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Cancers, online erschienen am 07.08.2023. Verfasst von Zaenab Alammar und 5 weiteren Autor:innen. Beteiligte Einrichtung: School of Computer Science, Queensland University of Technology, Brisbane, QLD 4000, Australia. Die Arbeit wurde bisher 35-mal zitiert (Crossref) und nennt 67 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Australian Government: The Australian Research Council (ARC) and the Industrial Transformation Training Centre (ITTC) for Joint Biomechanics.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Medical image classification poses significant challenges in real-world scenarios. One major obstacle is the scarcity of labelled training data, which hampers the performance of image-classification algorithms and generalisation. Gathering sufficient labelled data is often difficult and time-consuming in the medical domain, but deep learning (DL) has shown remarkable performance, although it typically requires a large amount of labelled data to achieve optimal results. Transfer learning (TL) has played a pivotal role in reducing the time, cost, and need for a large number of labelled images. This paper presents a novel TL approach that aims to overcome the limitations and disadvantages of TL that are characteristic of an ImageNet dataset, which belongs to a different domain. Our proposed TL approach involves training DL models on numerous medical images that are similar to the target dataset. These models were then fine-tuned using a small set of annotated medical images to leverage the knowledge gained from the pre-training phase. We specifically focused on medical X-ray imaging scenarios that involve the humerus and wrist from the musculoskeletal radiographs (MURA) dataset. Both of these tasks face significant challenges regarding accurate classification. The models trained with the proposed TL were used to extract features and were subsequently fused to train several machine learning (ML) classifiers. We combined these diverse features to represent various relevant characteristics in a comprehensive way. Through extensive evaluation, our proposed TL and feature-fusion approach using ML classifiers achieved remarkable results. For the classification of the humerus, we achieved an accuracy of 87.85%, an F1-score of 87.63%, and a Cohen’s Kappa coefficient of 75.69%. For wrist classification, our approach achieved an accuracy of 85.58%, an F1-score of 82.70%, and a Cohen’s Kappa coefficient of 70.46%. The results demonstrated that the models trained using our proposed TL approach outperformed those trained with ImageNet TL. We employed visualisation techniques to further validate these findings, including a gradient-based class activation heat map (Grad-CAM) and locally interpretable model-independent explanations (LIME). These visualisation tools provided additional evidence to support the superior accuracy of models trained with our proposed TL approach compared to those trained with ImageNet TL. Furthermore, our proposed TL approach exhibited greater robustness in various experiments compared to ImageNet TL. Importantly, the proposed TL approach and the feature-fusion technique are not limited to specific tasks. They can be applied to various medical image applications, thus extending their utility and potential impact. To demonstrate the concept of reusability, a computed tomography (CT) case was adopted. The results obtained from the proposed method showed improvements.

Schlagwörter

Stichwörter der Autor:innen

convolution neural network (CNN)data scarcitydeep learningfeature fusiongradient-based class activation heat mapmachine learningmusculoskeletal X-raytransfer learning

Autor:innen und Institutionen

  • School of Computer Science, Queensland University of Technology, Brisbane, QLD 4000, Australia.
  • Centre for Data Science, Queensland University of Technology, Brisbane, QLD 4000, Australia.
  • School of Mechanical, Medical and Process Engineering, Queensland University of Technology, Brisbane, QLD 4000, Australia.
  • ARC Industrial Transformation Training Centre-Joint Biomechanics, Queensland University of Technology, Brisbane, QLD 4000, Australia.
  • HMA Group, Brisbane, QLD 4172, Australia.

ORCID-Profile: Zaenab Alammar, Laith Alzubaidi, Yuefeng Li, Waail Lafta

Förderung

  • Australian Government: The Australian Research Council (ARC) and the Industrial Transformation Training Centre (ITTC) for Joint Biomechanics

Zitieren

APA

Alammar, Z., Alzubaidi, L., Zhang, J., Li, Y., Lafta, W., & Gu, Y. (2023). Deep Transfer Learning with Enhanced Feature Fusion for Detection of Abnormalities in X-ray Images. Cancers, 15(15), 4007. https://doi.org/10.3390/cancers15154007

Vancouver

Alammar Z, Alzubaidi L, Zhang J, Li Y, Lafta W, Gu Y. Deep Transfer Learning with Enhanced Feature Fusion for Detection of Abnormalities in X-ray Images. Cancers. 2023;15(15):4007. doi:10.3390/cancers15154007

BibTeX
@article{Alammar2023,
  author = {Alammar, Zaenab and Alzubaidi, Laith and Zhang, Jinglan and Li, Yuefeng and Lafta, Waail and Gu, Yuantong},
  title = {Deep Transfer Learning with Enhanced Feature Fusion for Detection of Abnormalities in X-ray Images},
  journal = {Cancers},
  year = {2023},
  volume = {15},
  number = {15},
  pages = {4007},
  doi = {10.3390/cancers15154007}
}
Kostenlos starten →