EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

TinyML Empowered Transfer Learning on the Edge

Ali M. Hayajneh, Maryam Hafeez, Syed Ali Raza Zaidi, Des McLernon

IEEE Open Journal of the Communications Society · 2024 · 5 · 1656-1672

DOI: 10.1109/ojcoms.2024.3373177 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Open Journal of the Communications Society, 2024. Verfasst von Ali M. Hayajneh und 3 weiteren Autor:innen. Die Arbeit wurde bisher 43-mal zitiert (Crossref) und nennt 53 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: Engineering and Physical Sciences Research Council (EPSRC) CHEDDAR, UK Research and Innovation, MSCA Horizon EU.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Tiny machine learning (TinyML) is a promising approach to enable intelligent applications relying on Human Activity Recognition (HAR) on resource-limited and low-power Internet of Things (IoT) edge devices. However, designing efficient TinyML models for these devices remains challenging due to computational resource constraints and the need for customisation to unique use cases. To address this, we propose a novel approach that utilises transfer learning (TL) techniques on edge micro-controller units (MCUs) to accelerate TinyML development. Our strategy involves pre-training generalised ML models on large-scale and varied datasets and fine-tuning them on-device for specific applications using TL. We demonstrate the effectiveness of our approach for HAR by experimenting with a convolutional neural network, long short-term memory TL (CNN-LSTM-TL) model architecture and visualisation techniques like t-distributed stochastic neighbour embedding (t-SNE) for dimensionality reduction. To further validate our model’s proficiency and adaptability, we conducted extensive testing using two distinct datasets: MotionSense and UCI. This dual-dataset approach allowed us to assess the robustness of our model across different data domains, showcasing its versatility and effectiveness in various HAR scenarios. Our results show significant model accuracy and reduced training time while maintaining high inference rates and low MCU memory footprint. We also provide insights into best practices for implementing TL on edge MCUs and evaluate classification performance metrics such as accuracy, precision, recall, F1 score, and categorical cross-entropy loss. Our work lays a solid foundation for faster and more efficient TinyML deployments through TL framework across different application domains and types of edge IoT devices.

Förderung

  • Engineering and Physical Sciences Research Council (EPSRC) CHEDDAR
  • UK Research and Innovation
  • MSCA Horizon EU
  • Abdul Hameed Shoman Foundation

Zitieren

APA

Hayajneh, A. M., Hafeez, M., Zaidi, S. A. R., & McLernon, D. (2024). TinyML Empowered Transfer Learning on the Edge. IEEE Open Journal of the Communications Society, 5, 1656-1672. https://doi.org/10.1109/ojcoms.2024.3373177

Vancouver

Hayajneh AM, Hafeez M, Zaidi SAR, McLernon D. TinyML Empowered Transfer Learning on the Edge. IEEE Open Journal of the Communications Society. 2024;5:1656-1672. doi:10.1109/ojcoms.2024.3373177

BibTeX
@article{Hayajneh2024,
  author = {Hayajneh, Ali M. and Hafeez, Maryam and Zaidi, Syed Ali Raza and McLernon, Des},
  title = {TinyML Empowered Transfer Learning on the Edge},
  journal = {IEEE Open Journal of the Communications Society},
  year = {2024},
  volume = {5},
  pages = {1656--1672},
  doi = {10.1109/ojcoms.2024.3373177}
}
Kostenlos starten →