EUVIMEDEUVIMED entdecken
Crossref

PipeSFL: A Fine-Grained Parallelization Framework for Split Federated Learning on Heterogeneous Clients

Yunqi Gao, Bing Hu, Mahdi Boloursaz Mashhadi, Wei Wang, Mehdi Bennis

IEEE Transactions on Mobile Computing · 2025-03 · 24 (3) · 1774-1791

DOI: 10.1109/tmc.2024.3489642 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Mobile Computing, 2025-03. Verfasst von Yunqi Gao und 4 weiteren Autor:innen. Die Arbeit wurde bisher 18-mal zitiert (Crossref) und nennt 65 Literaturangaben. Gefördert von: National Key Research and Development Project, Natural Science Foundation of Zhejiang Province, Nationa Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Split Federated Learning (SFL) improves scalability of Split Learning (SL) by enabling parallel computing of the learning tasks on multiple clients. However, state-of-the-art SFL schemes neglect the effects of heterogeneity in the clients’ computation and communication performance as well as the computation time for the tasks offloaded to the cloud server. In this paper, we propose a fine-grained parallelization framework, called PipeSFL, to accelerate SFL on heterogeneous clients. PipeSFL is based on two key novel ideas. First, we design a server-side priority scheduling mechanism to minimize per-iteration time. Second, we propose a hybrid training mode to reduce per-round time, which employs asynchronous training within rounds and synchronous training between rounds. We theoretically prove the optimality of the proposed priority scheduling mechanism within one round and analyze the total time per round for PipeSFL, SFL and SL. We implement PipeSFL on PyTorch. Extensive experiments on seven 64-client clusters with different heterogeneity demonstrate that at training speed, PipeSFL achieves up to 1.65x and 1.93x speedup compared to EPSL and SFL, respectively. At energy consumption, PipeSFL saves up to 30.8% and 43.4% of the energy consumed within each training round compared to EPSL and SFL, respectively.

Förderung

  • National Key Research and Development Project
  • Natural Science Foundation of Zhejiang Province
  • Nationa Natural Science Foundation of China

Zitieren

APA

Gao, Y., Hu, B., Mashhadi, M. B., Wang, W., & Bennis, M. (2025). PipeSFL: A Fine-Grained Parallelization Framework for Split Federated Learning on Heterogeneous Clients. IEEE Transactions on Mobile Computing, 24(3), 1774-1791. https://doi.org/10.1109/tmc.2024.3489642

Vancouver

Gao Y, Hu B, Mashhadi MB, Wang W, Bennis M. PipeSFL: A Fine-Grained Parallelization Framework for Split Federated Learning on Heterogeneous Clients. IEEE Transactions on Mobile Computing. 2025;24(3):1774-1791. doi:10.1109/tmc.2024.3489642

BibTeX
@article{Gao2025,
  author = {Gao, Yunqi and Hu, Bing and Mashhadi, Mahdi Boloursaz and Wang, Wei and Bennis, Mehdi},
  title = {PipeSFL: A Fine-Grained Parallelization Framework for Split Federated Learning on Heterogeneous Clients},
  journal = {IEEE Transactions on Mobile Computing},
  year = {2025},
  volume = {24},
  number = {3},
  pages = {1774--1791},
  doi = {10.1109/tmc.2024.3489642}
}
Kostenlos starten →