EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Flexible Deployment of Machine Learning Inference Pipelines in the Cloud–Edge–IoT Continuum

Karolina Bogacka, Piotr Sowiński, Anastasiya Danilenka, Francisco Mahedero Biot, Katarzyna Wasielewska-Michniewska, Maria Ganzha, Marcin Paprzycki, Carlos E. Palau

Electronics · 11.05.2024 · 13 (10) · 1888

DOI: 10.3390/electronics13101888 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Electronics, online erschienen am 11.05.2024. Verfasst von Karolina Bogacka und 7 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 68 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: European Commission, Horizon Europe project aerOS.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Currently, deploying machine learning workloads in the Cloud–Edge–IoT continuum is challenging due to the wide variety of available hardware platforms, stringent performance requirements, and the heterogeneity of the workloads themselves. To alleviate this, a novel, flexible approach for machine learning inference is introduced, which is suitable for deployment in diverse environments—including edge devices. The proposed solution has a modular design and is compatible with a wide range of user-defined machine learning pipelines. To improve energy efficiency and scalability, a high-performance communication protocol for inference is propounded, along with a scale-out mechanism based on a load balancer. The inference service plugs into the ASSIST-IoT reference architecture, thus taking advantage of its other components. The solution was evaluated in two scenarios closely emulating real-life use cases, with demanding workloads and requirements constituting several different deployment scenarios. The results from the evaluation show that the proposed software meets the high throughput and low latency of inference requirements of the use cases while effectively adapting to the available hardware. The code and documentation, in addition to the data used in the evaluation, were open-sourced to foster adoption of the solution.

Förderung

  • European Commission
  • Horizon Europe project aerOS

Zitieren

APA

Bogacka, K., Sowiński, P., Danilenka, A., Biot, F. M., Wasielewska-Michniewska, K., Ganzha, M., Paprzycki, M., & Palau, C. E. (2024). Flexible Deployment of Machine Learning Inference Pipelines in the Cloud–Edge–IoT Continuum. Electronics, 13(10), 1888. https://doi.org/10.3390/electronics13101888

Vancouver

Bogacka K, Sowiński P, Danilenka A, Biot FM, Wasielewska-Michniewska K, Ganzha M, et al. Flexible Deployment of Machine Learning Inference Pipelines in the Cloud–Edge–IoT Continuum. Electronics. 2024;13(10):1888. doi:10.3390/electronics13101888

BibTeX
@article{Bogacka2024,
  author = {Bogacka, Karolina and Sowiński, Piotr and Danilenka, Anastasiya and Biot, Francisco Mahedero and Wasielewska-Michniewska, Katarzyna and Ganzha, Maria and Paprzycki, Marcin and Palau, Carlos E.},
  title = {Flexible Deployment of Machine Learning Inference Pipelines in the Cloud–Edge–IoT Continuum},
  journal = {Electronics},
  year = {2024},
  volume = {13},
  number = {10},
  pages = {1888},
  doi = {10.3390/electronics13101888}
}
Kostenlos starten →