Flexible Deployment of Machine Learning Inference Pipelines in the Cloud–Edge–IoT Continuum
Electronics · 11.05.2024 · 13 (10) · 1888
DOI: 10.3390/electronics13101888 ↗Kurz gefasst
Fachartikel in der Zeitschrift Electronics, online erschienen am 11.05.2024. Verfasst von Karolina Bogacka und 7 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 68 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: European Commission, Horizon Europe project aerOS.
Abstract (Originalsprache)
Currently, deploying machine learning workloads in the Cloud–Edge–IoT continuum is challenging due to the wide variety of available hardware platforms, stringent performance requirements, and the heterogeneity of the workloads themselves. To alleviate this, a novel, flexible approach for machine learning inference is introduced, which is suitable for deployment in diverse environments—including edge devices. The proposed solution has a modular design and is compatible with a wide range of user-defined machine learning pipelines. To improve energy efficiency and scalability, a high-performance communication protocol for inference is propounded, along with a scale-out mechanism based on a load balancer. The inference service plugs into the ASSIST-IoT reference architecture, thus taking advantage of its other components. The solution was evaluated in two scenarios closely emulating real-life use cases, with demanding workloads and requirements constituting several different deployment scenarios. The results from the evaluation show that the proposed software meets the high throughput and low latency of inference requirements of the use cases while effectively adapting to the available hardware. The code and documentation, in addition to the data used in the evaluation, were open-sourced to foster adoption of the solution.
Förderung
- European Commission
- Horizon Europe project aerOS
Zitieren
APA
Bogacka, K., Sowiński, P., Danilenka, A., Biot, F. M., Wasielewska-Michniewska, K., Ganzha, M., Paprzycki, M., & Palau, C. E. (2024). Flexible Deployment of Machine Learning Inference Pipelines in the Cloud–Edge–IoT Continuum. Electronics, 13(10), 1888. https://doi.org/10.3390/electronics13101888
Vancouver
Bogacka K, Sowiński P, Danilenka A, Biot FM, Wasielewska-Michniewska K, Ganzha M, et al. Flexible Deployment of Machine Learning Inference Pipelines in the Cloud–Edge–IoT Continuum. Electronics. 2024;13(10):1888. doi:10.3390/electronics13101888
BibTeX
@article{Bogacka2024,
author = {Bogacka, Karolina and Sowiński, Piotr and Danilenka, Anastasiya and Biot, Francisco Mahedero and Wasielewska-Michniewska, Katarzyna and Ganzha, Maria and Paprzycki, Marcin and Palau, Carlos E.},
title = {Flexible Deployment of Machine Learning Inference Pipelines in the Cloud–Edge–IoT Continuum},
journal = {Electronics},
year = {2024},
volume = {13},
number = {10},
pages = {1888},
doi = {10.3390/electronics13101888}
}
EUVIMED