EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Understanding the black-box: towards interpretable and reliable deep learning models

Tehreem Qamar, Narmeen Zakaria Bawany

PeerJ Computer Science · 29.11.2023 · 9 · e1629

DOI: 10.7717/peerj-cs.1629 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PeerJ Computer Science, online erschienen am 29.11.2023. Verfasst von Tehreem Qamar und 1 weiteren Autor:innen. Beteiligte Einrichtung: Center for Computing Research, Department of Computer Science and Software Engineering, Jinnah University for Women, Karachi, Pakistan. Die Arbeit wurde bisher 84-mal zitiert (Crossref) und nennt 56 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Deep learning (DL) has revolutionized the field of artificial intelligence by providing sophisticated models across a diverse range of applications, from image and speech recognition to natural language processing and autonomous driving. However, deep learning models are typically black-box models where the reason for predictions is unknown. Consequently, the reliability of the model becomes questionable in many circumstances. Explainable AI (XAI) plays an important role in improving the transparency and interpretability of the model thereby making it more reliable for real-time deployment. To investigate the reliability and truthfulness of DL models, this research develops image classification models using transfer learning mechanism and validates the results using XAI technique. Thus, the contribution of this research is twofold, we employ three pre-trained models VGG16, MobileNetV2 and ResNet50 using multiple transfer learning techniques for a fruit classification task consisting of 131 classes. Next, we inspect the reliability of models, based on these pre-trained networks, by utilizing Local Interpretable Model-Agnostic Explanations, the LIME, a popular XAI technique that generates explanations for the predictions. Experimental results reveal that transfer learning provides optimized results of around 98% accuracy. The classification of the models is validated on different instances using LIME and it was observed that each model predictions are interpretable and understandable as they are based on pertinent image features that are relevant to particular classes. We believe that this research gives an insight for determining how an interpretation can be drawn from a complex AI model such that its accountability and trustworthiness can be increased.

Schlagwörter

Stichwörter der Autor:innen

Deep learningExplainable AIPre-trained modelsTransfer learning

Autor:innen und Institutionen

  • Center for Computing Research, Department of Computer Science and Software Engineering, Jinnah University for Women, Karachi, Pakistan.

Zitieren

APA

Qamar, T., & Bawany, N. Z. (2023). Understanding the black-box: towards interpretable and reliable deep learning models. PeerJ Computer Science, 9, e1629. https://doi.org/10.7717/peerj-cs.1629

Vancouver

Qamar T, Bawany NZ. Understanding the black-box: towards interpretable and reliable deep learning models. PeerJ Computer Science. 2023;9:e1629. doi:10.7717/peerj-cs.1629

BibTeX
@article{Qamar2023,
  author = {Qamar, Tehreem and Bawany, Narmeen Zakaria},
  title = {Understanding the black-box: towards interpretable and reliable deep learning models},
  journal = {PeerJ Computer Science},
  year = {2023},
  volume = {9},
  pages = {e1629},
  doi = {10.7717/peerj-cs.1629}
}
Kostenlos starten →