A Communication-Efficient Hierarchical Federated Learning Framework via Shaping Data Distribution at Edge
IEEE/ACM Transactions on Networking · 2024-06 · 32 (3) · 2600-2615
DOI: 10.1109/tnet.2024.3363916 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE/ACM Transactions on Networking, 2024-06. Verfasst von Yongheng Deng und 6 weiteren Autor:innen. Die Arbeit wurde bisher 77-mal zitiert (Crossref) und nennt 62 Literaturangaben. Gefördert von: National Key Research and Development Program of China, National Natural Science Foundation of China, Higher Education Discipline Innovation Project.
Abstract (Originalsprache)
Federated learning (FL) enables collaborative model training over distributed computing nodes without sharing their privacy-sensitive raw data. However, in FL, iterative exchanges of model updates between distributed nodes and the cloud server can result in significant communication cost, especially when the data distributions at distributed nodes are imbalanced with requiring more rounds of iterations. In this paper, with our in-depth empirical studies, we disclose that extensive cloud aggregations can be avoided without compromising the learning accuracy if frequent aggregations can be enabled at edge network. To this end, we shed light on the hierarchical federated learning (HFL) framework, where a subset of distributed nodes can play as edge aggregators to support edge aggregations. Under the HFL framework, we formulate a communication cost minimization (CCM) problem to minimize the total communication cost required for model learning with a target accuracy by making decisions on edge aggragator selection and node-edge associations. Inspired by our data-driven insights that the potential of HFL lies in the data distribution at edge aggregators, we propose ShapeFL, i.e., SHaping dAta distRibution at Edge, to transform and solve the CCM problem. In ShapeFL, we divide the original problem into two sub-problems to minimize the per-round communication cost and maximize the data distribution diversity of edge aggregator data, respectively, and devise two light-weight algorithms to solve them accordingly. Extensive experiments are carried out based on several opened datasets and real-world network topologies, and the results demonstrate the efficacy of ShapeFL in terms of both learning accuracy and communication efficiency.
Förderung
- National Key Research and Development Program of China
- National Natural Science Foundation of China
- Higher Education Discipline Innovation Project
- Young Talents Plan of Hunan Province of China
- Central South University Innovation-Driven Research Programme
- Guoqiang Institute, Tsinghua University
Zitieren
APA
Deng, Y., Lyu, F., Xia, T., Zhou, Y., Zhang, Y., Ren, J., & Yang, Y. (2024). A Communication-Efficient Hierarchical Federated Learning Framework via Shaping Data Distribution at Edge. IEEE/ACM Transactions on Networking, 32(3), 2600-2615. https://doi.org/10.1109/tnet.2024.3363916
Vancouver
Deng Y, Lyu F, Xia T, Zhou Y, Zhang Y, Ren J, et al. A Communication-Efficient Hierarchical Federated Learning Framework via Shaping Data Distribution at Edge. IEEE/ACM Transactions on Networking. 2024;32(3):2600-2615. doi:10.1109/tnet.2024.3363916
BibTeX
@article{Deng2024,
author = {Deng, Yongheng and Lyu, Feng and Xia, Tengxi and Zhou, Yuezhi and Zhang, Yaoxue and Ren, Ju and Yang, Yuanyuan},
title = {A Communication-Efficient Hierarchical Federated Learning Framework via Shaping Data Distribution at Edge},
journal = {IEEE/ACM Transactions on Networking},
year = {2024},
volume = {32},
number = {3},
pages = {2600--2615},
doi = {10.1109/tnet.2024.3363916}
}
EUVIMED