FedA4: Federated Learning with Anti-Bias Aggregation and TrAjectory-Based Adaptation
Transactions on Artificial Intelligence · 2026
DOI: 10.53941/tai.2026.100003 ↗Kurz gefasst
Fachartikel in der Zeitschrift Transactions on Artificial Intelligence, 2026. Verfasst von Guanyi Zhao und 3 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Hong Kong Research Grants Council, Hong Kong Innovation and Technology Commission.
Abstract (Originalsprache)
Non-Independent and Identically Distributed (Non-IID) data pose a fundamental challenge in Federated Learning (FL). It usually causes a severe client drift issue (various client model update directions) and thus, degrades the global model performance. Existing methods typically address this by assigning appropriate weights to client models or optimizing model update directions. However, these methods overlook client model update trends. They focus solely on the final client models to be aggregated at the server at each communication round, ignoring model optimization trajectories, which may contain richer information to aid model convergence. To address this issue, we propose FedA4, a novel FL framework with Anti-bias Aggregation and trAjectory-based Adaptation, which leverages clients’ optimization trajectories, rather than only their final model snapshots. For anti-bias aggregation, by observing a phenomenon termed model collapse, where biased clients tend to predict any input data as the dominant classes in their own datasets, we quantify the class dominance and analyze the level of client drift for each client. We evaluate a prediction entropy, namely concentration, so as to assign an optimal weight to each client at each training round. To further mitigate the negative effect of clients with high levels of client drift (biased clients), we then develop a gradient adaptation mechanism termed trajectory-based adaptation, which analyzes clients’ trajectories to correct each client’s contribution to the aggregated global model. Extensive experiments on CIFAR-10, CIFAR-100, STL-10, and Fashion-MNIST demonstrate that FedA4 significantly outperforms state-of-the-art baselines, particularly in scenarios with extreme data heterogeneity (high level of Non-IID).
Förderung
- Hong Kong Research Grants Council
- Hong Kong Innovation and Technology Commission
Zitieren
APA
Zhao, G., Hu, J., Yang, Z., & Wu, D. O. (2026). FedA4: Federated Learning with Anti-Bias Aggregation and TrAjectory-Based Adaptation. Transactions on Artificial Intelligence. https://doi.org/10.53941/tai.2026.100003
Vancouver
Zhao G, Hu J, Yang Z, Wu DO. FedA4: Federated Learning with Anti-Bias Aggregation and TrAjectory-Based Adaptation. Transactions on Artificial Intelligence. 2026. doi:10.53941/tai.2026.100003
BibTeX
@article{Zhao2026,
author = {Zhao, Guanyi and Hu, Juntao and Yang, Zhengjie and Wu, Dapeng Oliver},
title = {FedA4: Federated Learning with Anti-Bias Aggregation and TrAjectory-Based Adaptation},
journal = {Transactions on Artificial Intelligence},
year = {2026},
doi = {10.53941/tai.2026.100003}
}
EUVIMED