Efficient Federated Recommender System with Adaptive Model Pruning and Momentum-based Batch Adjustment
ACM Transactions on Recommender Systems · 30.09.2025 · 3 (3) · 1-23
DOI: 10.1145/3704267 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Recommender Systems, online erschienen am 22.03.2025. Verfasst von Hongjian Shi und 6 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 44 Literaturangaben. Gefördert von: Shanghai Key Laboratory of Scalable Computing and Systems, Wuxi IoT Innovation Promotion Center, Industry-University-Research Cooperation Funding Project from the Eighth Research Institute in China Aerospace Science and Technology Corporation.
Abstract (Originalsprache)
With the development of 5G communication and smart devices, the prosperity of online content has boosted Recommender System (RS) research. Due to the data scarcity problem, researchers employ knowledge transfer techniques to improve the accuracy of RS. Data sharing or data augmentation are promising methods for such a problem, but the data suffers from privacy leakage during sharing. Thus, federated learning has been adopted to collaboratively train recommender models while preserving data privacy. Federated Recommender System (FRS) combines federated learning and RS to provide distributed recommendation services to the users. However, the existing FRS suffers from massive communication and system heterogeneity, where the necessity of model transmission and the diversity of the clients bring significant communication overhead to the system. In this article, we propose Efficient Federated Recommender System with Adaptive Model Pruning and Momentum-based Batch Adjustment ( \(eFRSA^{2}\) ) to reduce the communication overhead of FRS. \(eFRSA^{2}\) contains two modules. Adaptive Model Pruning utilizes magnitude pruning to reduce the communication volume and adaptively modifies the compression ratios of different clients to maintain the model accuracy. Momentum-based Batch Adjustment adjusts the local training batch number by a similar method of gradient descent with momentum to align the local computation time of the clients and reduce the communication overhead. The experimental results demonstrate that \(eFRSA^{2}\) can reduce up to 90% communication volume and mitigate the system heterogeneity by over 75%, demonstrating the priority of \(eFRSA^{2}\) in training efficiency. Source code can be found at https://github.com/shhjwu5/eFRSA2 .
Förderung
- Shanghai Key Laboratory of Scalable Computing and Systems
- Wuxi IoT Innovation Promotion Center
- Industry-University-Research Cooperation Funding Project from the Eighth Research Institute in China Aerospace Science and Technology Corporation
Zitieren
APA
Shi, H., Di, Y., Ruan, X., Liao, M., Zhang, Q., Ma, R., & Guan, H. (2025). Efficient Federated Recommender System with Adaptive Model Pruning and Momentum-based Batch Adjustment. ACM Transactions on Recommender Systems, 3(3), 1-23. https://doi.org/10.1145/3704267
Vancouver
Shi H, Di Y, Ruan X, Liao M, Zhang Q, Ma R, et al. Efficient Federated Recommender System with Adaptive Model Pruning and Momentum-based Batch Adjustment. ACM Transactions on Recommender Systems. 2025;3(3):1-23. doi:10.1145/3704267
BibTeX
@article{Shi2025,
author = {Shi, Hongjian and Di, Yicheng and Ruan, Xinyu and Liao, Mingrui and Zhang, Qian and Ma, Ruhui and Guan, Haibing},
title = {Efficient Federated Recommender System with Adaptive Model Pruning and Momentum-based Batch Adjustment},
journal = {ACM Transactions on Recommender Systems},
year = {2025},
volume = {3},
number = {3},
pages = {1--23},
doi = {10.1145/3704267}
}
EUVIMED