Power Efficient Machine Learning Models Deployment on Edge IoT Devices
Sensors · 01.02.2023 · 23 (3) · 1595
DOI: 10.3390/s23031595 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 01.02.2023. Verfasst von Anastasios Fanariotis und 5 weiteren Autor:innen. Beteiligte Einrichtung: Digital Systems and Media Computing Lab, School of Sciences and Technology, Hellenic Open University, 26334 Patras, Greece. Die Arbeit wurde bisher 71-mal zitiert (Crossref) und nennt 19 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Computing has undergone a significant transformation over the past two decades, shifting from a machine-based approach to a human-centric, virtually invisible service known as ubiquitous or pervasive computing. This change has been achieved by incorporating small embedded devices into a larger computational system, connected through networking and referred to as edge devices. When these devices are also connected to the Internet, they are generally named Internet-of-Thing (IoT) devices. Developing Machine Learning (ML) algorithms on these types of devices allows them to provide Artificial Intelligence (AI) inference functions such as computer vision, pattern recognition, etc. However, this capability is severely limited by the device’s resource scarcity. Embedded devices have limited computational and power resources available while they must maintain a high degree of autonomy. While there are several published studies that address the computational weakness of these small systems-mostly through optimization and compression of neural networks- they often neglect the power consumption and efficiency implications of these techniques. This study presents power efficiency experimental results from the application of well-known and proven optimization methods using a set of well-known ML models. The results are presented in a meaningful manner considering the “real world” functionality of devices and the provided results are compared with the basic “idle” power consumption of each of the selected systems. Two different systems with completely different architectures and capabilities were used providing us with results that led to interesting conclusions related to the power efficiency of each architecture.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Digital Systems and Media Computing Lab, School of Sciences and Technology, Hellenic Open University, 26334 Patras, Greece.
- Department of Informatics, Aristotle University of Thessaloniki, 54124 Thessaloniki, Greece.
- Department of Informatics and Computer Engineering, University of West Attica, 12243 Athens, Greece.
ORCID-Profile: Anastasios Fanariotis, Vassilis Fotopoulos, Panagiotis Karkazis
Zitieren
APA
Fanariotis, A., Orphanoudakis, T., Kotrotsios, K., Fotopoulos, V., Keramidas, G., & Karkazis, P. (2023). Power Efficient Machine Learning Models Deployment on Edge IoT Devices. Sensors, 23(3), 1595. https://doi.org/10.3390/s23031595
Vancouver
Fanariotis A, Orphanoudakis T, Kotrotsios K, Fotopoulos V, Keramidas G, Karkazis P. Power Efficient Machine Learning Models Deployment on Edge IoT Devices. Sensors. 2023;23(3):1595. doi:10.3390/s23031595
BibTeX
@article{Fanariotis2023,
author = {Fanariotis, Anastasios and Orphanoudakis, Theofanis and Kotrotsios, Konstantinos and Fotopoulos, Vassilis and Keramidas, George and Karkazis, Panagiotis},
title = {Power Efficient Machine Learning Models Deployment on Edge IoT Devices},
journal = {Sensors},
year = {2023},
volume = {23},
number = {3},
pages = {1595},
doi = {10.3390/s23031595}
}
EUVIMED