Toward Improving Ensemble-Based Collaborative Inference at the Edge
IEEE Access · 2024 · 12 · 6926-6940
DOI: 10.1109/access.2024.3351308 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Access, 2024. Verfasst von Shungo Kumazawa und 4 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 38 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: JST CREST, Japan, KAKENHI, Japan.
Abstract (Originalsprache)
Ensemble-based collaborative inference systems, Edge Ensembles, are deep learning edge inference systems that enhance accuracy by aggregating predictions from models deployed on each device. They offer several advantages, including scalability based on task complexity and decentralized functionality without dependency on centralized servers. In general, ensemble methods effectively improve the accuracy of deep learning, and conventional research uses several model integration techniques for deep learning ensembles. Some of these existing integration methods are more effective than those used in previous Edge Ensembles. However, it remains uncertain whether these methods can be directly applied in the context of cooperative inference systems involving multiple edge devices. This study investigates the effectiveness of conventional model integration techniques, including cascade, weighted averaging, and test-time augmentation (TTA), when applied to Edge Ensembles to enhance their performance. Furthermore, we propose enhancements of these techniques tailored for Edge Ensembles. The cascade reduces the number of models required for inference but worsens latency by sequential inference processing. To address this latency issue, we propose $m$ -parallel cascade, which adjusts the number of models processed simultaneously to $m$ . We also propose learning TTA policies and weights for weighted averaging using ensemble prediction labels instead of ground truth labels. In the experiments, we verified the effectiveness of each technique for Edge Ensembles. The proposed $m$ -parallel cascade achieved a 2.8 times reduction in latency compared to the conventional cascade, even with a 1.06 times increase in computational costs. Additionally, the ensemble label-based learning demonstrated comparable effectiveness to the approach using ground truth labels.
Förderung
- JST CREST, Japan
- KAKENHI, Japan
Zitieren
APA
Kumazawa, S., Yu, J., Kawamura, K., Chu, T. V., & Motomura, M. (2024). Toward Improving Ensemble-Based Collaborative Inference at the Edge. IEEE Access, 12, 6926-6940. https://doi.org/10.1109/access.2024.3351308
Vancouver
Kumazawa S, Yu J, Kawamura K, Chu TV, Motomura M. Toward Improving Ensemble-Based Collaborative Inference at the Edge. IEEE Access. 2024;12:6926-6940. doi:10.1109/access.2024.3351308
BibTeX
@article{Kumazawa2024,
author = {Kumazawa, Shungo and Yu, Jaehoon and Kawamura, Kazushi and Chu, Thiem Van and Motomura, Masato},
title = {Toward Improving Ensemble-Based Collaborative Inference at the Edge},
journal = {IEEE Access},
year = {2024},
volume = {12},
pages = {6926--6940},
doi = {10.1109/access.2024.3351308}
}
EUVIMED