EUVIMEDAvasta EUVIMED
Open access · CC BY-NC 4.0

Dynamic Hyper-Parameter Adjustment in Fedprox for Performance Optimization in Federated Learning

Yunfan Zhang

Mathematical Modeling and Algorithm Application · 2026-03-15 · 9 (1) · 36-45

DOI: 10.54097/fphadj19 ↗

At a glance

Journal article in Mathematical Modeling and Algorithm Application, published online on 2026-03-15. Written by Yunfan Zhang. The full text is freely available (open access, CC BY-NC 4.0).

AbstraktBibliograafilised andmedCiteRelated studies

Abstract (original language)

This paper investigates the application of dynamic hyper-parameter adjustment strategies to improve the performance of the FedProx algorithm in federated learning (FL). FedProx addresses the challenges posed by data heterogeneity across clients, a common issue in FL that hinders convergence. While FedProx improves upon the basic FedAvg algorithm by introducing a proximal term to stabilize model updates, the hyper-parameter μ that controls the impact of the proximal term is sensitive and needs careful tuning. An inappropriate μ can degrade performance, making dynamic adjustment crucial. The study introduces two dynamic μ adjustment strategies. The first strategy, called ExponentialDecay, progressively reduces μ exponentially by multiplying it with a constant factor. The second strategy, AdaptiveLoss, adjusts μ based on changes in the loss value, decreasing it when the loss decreases and increasing it when the loss increases, offering a more responsive approach to the model’s performance. The effectiveness of both strategies is evaluated on the EMNIST dataset, which simulates real-world non-IID data distributions. Results show that both dynamic strategies outperform the static μ setting in terms of model accuracy, loss reduction, and training speed, particularly in scenarios with highly heterogeneous data. Specifically, the AdaptiveLoss strategy achieves the best performance when the data is extremely non-IID, reducing loss by 10.2% and improving accuracy by 2.5% compared to the static μ approach. These dynamic strategies not only enhance FedProx’s stability but also accelerate the convergence of the global model.

Cite

APA

Zhang, Y. (2026). Dynamic Hyper-Parameter Adjustment in Fedprox for Performance Optimization in Federated Learning. Mathematical Modeling and Algorithm Application, 9(1), 36-45. https://doi.org/10.54097/fphadj19

Vancouver

Zhang Y. Dynamic Hyper-Parameter Adjustment in Fedprox for Performance Optimization in Federated Learning. Mathematical Modeling and Algorithm Application. 2026;9(1):36-45. doi:10.54097/fphadj19

BibTeX
@article{Zhang2026,
  author = {Zhang, Yunfan},
  title = {Dynamic Hyper-Parameter Adjustment in Fedprox for Performance Optimization in Federated Learning},
  journal = {Mathematical Modeling and Algorithm Application},
  year = {2026},
  volume = {9},
  number = {1},
  pages = {36--45},
  doi = {10.54097/fphadj19}
}
Start for free →